Jul 23 21:23:53.635361 ip-10-0-134-221 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 23 21:23:53.635377 ip-10-0-134-221 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 23 21:23:53.635387 ip-10-0-134-221 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 23 21:23:53.635806 ip-10-0-134-221 systemd[1]: Failed to start Kubernetes Kubelet. Jul 23 21:24:03.782898 ip-10-0-134-221 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 23 21:24:03.782916 ip-10-0-134-221 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f54f241e11654d66892990682419a24e -- Jul 23 21:26:05.509903 ip-10-0-134-221 systemd[1]: Starting Kubernetes Kubelet... Jul 23 21:26:05.935671 ip-10-0-134-221 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 21:26:05.935671 ip-10-0-134-221 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 21:26:05.935671 ip-10-0-134-221 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 21:26:05.935671 ip-10-0-134-221 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 21:26:05.935671 ip-10-0-134-221 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 21:26:05.937021 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.936933 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 21:26:05.943625 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943610 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:26:05.943625 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943637 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943642 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943645 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943648 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943651 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943654 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943657 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943660 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943662 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943666 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943669 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943671 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943674 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943676 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943679 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943682 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943684 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943687 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943689 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943694 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:26:05.943699 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943698 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943701 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943704 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943707 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943711 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943714 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943717 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943722 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943725 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943728 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943730 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943733 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943735 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943738 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943740 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943743 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943745 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943748 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943750 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943753 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:26:05.944161 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943755 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943758 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943761 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943763 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943765 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943768 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943771 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943773 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943776 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943779 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943781 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943784 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943787 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943790 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943794 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943796 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943799 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943802 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943804 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:26:05.944660 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943807 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943810 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943813 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943815 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943818 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943821 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943823 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943826 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943828 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943831 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943834 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943836 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943840 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943844 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943848 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943852 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943855 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943858 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943861 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:26:05.945116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943864 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943868 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943871 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943873 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943876 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943878 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943881 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943884 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943887 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943890 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943893 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943895 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943898 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943900 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943903 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943905 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943908 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943911 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943913 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.943916 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:26:05.945562 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944583 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944590 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944592 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944595 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944598 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944600 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944604 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944606 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944609 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944611 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944614 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944616 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944619 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944621 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944625 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944643 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944646 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944649 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944651 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944655 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:26:05.946135 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944658 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944661 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944664 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944667 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944670 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944672 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944675 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944678 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944680 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944683 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944686 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944689 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944691 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944696 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944700 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944703 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944707 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944710 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944713 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:26:05.946645 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944716 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944718 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944721 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944723 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944727 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944730 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944732 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944734 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944737 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944740 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944742 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944745 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944748 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944751 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944753 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944756 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944759 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944761 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944764 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944767 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:26:05.947116 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944769 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944772 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944774 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944777 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944779 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944782 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944784 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944787 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944789 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944792 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944795 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944797 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944799 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944802 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944804 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944806 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944809 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944811 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944815 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:26:05.947600 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944817 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944819 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944822 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944825 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944827 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944830 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944833 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944836 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944839 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944842 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944844 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944847 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944850 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944853 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944856 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944858 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944861 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944863 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944866 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944868 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:26:05.948090 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.944871 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946026 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946033 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946036 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946039 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946044 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946047 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946050 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946054 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946057 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946059 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946061 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946064 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946067 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946070 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946072 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946075 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946077 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946080 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:26:05.948689 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946083 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946085 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946088 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946090 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946093 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946095 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946098 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946100 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946103 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946105 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946108 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946110 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946113 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946115 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946118 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946121 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946123 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946125 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946128 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946131 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:26:05.949142 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946134 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946137 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946140 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946142 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946145 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946147 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946150 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946152 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946155 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946158 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946160 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946163 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946166 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946168 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946171 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946173 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946176 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946178 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946181 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946183 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:26:05.949681 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946186 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946188 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946191 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946193 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946196 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946199 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946201 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946204 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946206 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946208 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946210 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946213 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946216 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946218 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946221 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946224 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946227 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946229 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946231 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:26:05.950163 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946235 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946238 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946242 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946244 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946248 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946252 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946254 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946257 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946260 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946262 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946265 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946268 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946270 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946272 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946275 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946277 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946280 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946282 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946285 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946287 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:26:05.950646 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946290 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946292 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946359 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946371 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946378 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946382 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946386 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946389 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946393 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946397 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946400 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946403 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946406 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946409 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946412 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946416 2576 flags.go:64] FLAG: --cgroup-root="" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946422 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946425 2576 flags.go:64] FLAG: --client-ca-file="" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946429 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946431 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946436 2576 flags.go:64] FLAG: --cluster-domain="" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946438 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946441 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946444 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 21:26:05.951183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946447 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946452 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946454 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946457 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946461 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946463 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946466 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946469 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946472 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946475 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946479 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946482 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946485 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946487 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946490 2576 flags.go:64] FLAG: --enable-server="true" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946493 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946498 2576 flags.go:64] FLAG: --event-burst="100" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946501 2576 flags.go:64] FLAG: --event-qps="50" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946503 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946506 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946509 2576 flags.go:64] FLAG: --eviction-hard="" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946513 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946515 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946518 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946523 2576 flags.go:64] FLAG: --eviction-soft="" Jul 23 21:26:05.951767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946526 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946529 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946532 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946535 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946538 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946540 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946543 2576 flags.go:64] FLAG: --feature-gates="" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946547 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946550 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946553 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946556 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946559 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946562 2576 flags.go:64] FLAG: --help="false" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946565 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-134-221.ec2.internal" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946568 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946571 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946574 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946577 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946580 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946583 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946586 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946589 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946592 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 21:26:05.952352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946595 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946598 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946601 2576 flags.go:64] FLAG: --kube-reserved="" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946604 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946607 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946609 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946612 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946615 2576 flags.go:64] FLAG: --lock-file="" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946619 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946623 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946639 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946645 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946648 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946651 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946653 2576 flags.go:64] FLAG: --logging-format="text" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946656 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946660 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946663 2576 flags.go:64] FLAG: --manifest-url="" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946666 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946670 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946673 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946679 2576 flags.go:64] FLAG: --max-pods="110" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946682 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946685 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946688 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 21:26:05.952952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946691 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946694 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946697 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946699 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946706 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946709 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946712 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946715 2576 flags.go:64] FLAG: --pod-cidr="" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946718 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946723 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946726 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946729 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946732 2576 flags.go:64] FLAG: --port="10250" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946735 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946738 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e78f7f7ca9c8df61" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946741 2576 flags.go:64] FLAG: --qos-reserved="" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946745 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946749 2576 flags.go:64] FLAG: --register-node="true" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946752 2576 flags.go:64] FLAG: --register-with-taints="" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946755 2576 flags.go:64] FLAG: --registry-burst="10" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946758 2576 flags.go:64] FLAG: --registry-qps="5" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946761 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946764 2576 flags.go:64] FLAG: --reserved-memory="" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946767 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946770 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 21:26:05.953549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946773 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946776 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946778 2576 flags.go:64] FLAG: --runonce="false" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946782 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946785 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946788 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946791 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946793 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946796 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946799 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946802 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946805 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946808 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946810 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946813 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946816 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946819 2576 flags.go:64] FLAG: --system-cgroups="" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946822 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946827 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946829 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946832 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946836 2576 flags.go:64] FLAG: --tls-min-version="" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946839 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946843 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946855 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 21:26:05.954174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946859 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946862 2576 flags.go:64] FLAG: --v="2" Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946866 2576 flags.go:64] FLAG: --version="false" Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946870 2576 flags.go:64] FLAG: --vmodule="" Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946874 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.946877 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946987 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946991 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946994 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.946997 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947001 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947004 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947006 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947009 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947011 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947014 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947016 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947019 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947022 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947024 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947026 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:26:05.954912 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947029 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947031 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947034 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947036 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947038 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947041 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947043 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947046 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947048 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947052 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947055 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947057 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947060 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947063 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947065 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947068 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947070 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947073 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947075 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947078 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:26:05.955417 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947080 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947084 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947086 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947089 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947091 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947094 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947096 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947098 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947101 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947104 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947106 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947109 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947111 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947113 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947116 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947118 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947121 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947124 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947126 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947129 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:26:05.955907 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947132 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947135 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947139 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947143 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947146 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947149 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947152 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947154 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947157 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947159 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947162 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947164 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947166 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947170 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947173 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947175 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947178 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947180 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947183 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947185 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:26:05.956387 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947188 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947190 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947193 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947196 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947199 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947203 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947205 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947208 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947211 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947214 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947216 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947219 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947222 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947225 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947227 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947231 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947234 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947237 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947240 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:26:05.956884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947243 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947245 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947248 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947250 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.947252 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.947258 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.954297 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.954314 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.954333 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.954343 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954403 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954408 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954411 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954414 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954417 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:26:05.957338 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954420 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954423 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954426 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954429 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954431 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954434 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954437 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954439 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954442 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954444 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954446 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954449 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954451 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954454 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954456 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954459 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954461 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954464 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954466 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:26:05.957732 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954470 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954473 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954476 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954479 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954482 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954491 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954494 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954497 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954499 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954502 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954505 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954507 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954510 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954514 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954518 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954520 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954523 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954525 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954528 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:26:05.958185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954530 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954533 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954535 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954538 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954540 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954543 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954545 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954547 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954550 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954552 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954555 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954557 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954560 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954562 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954565 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954568 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954570 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954573 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954576 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954585 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:26:05.958741 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954588 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954590 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954593 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954595 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954597 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954600 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954603 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954605 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954607 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954610 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954612 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954615 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954617 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954619 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954622 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954624 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954644 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954647 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954650 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954652 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:26:05.959213 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954655 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954659 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954663 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954666 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954668 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954671 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954674 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954676 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954679 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954681 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954685 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954687 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954696 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954699 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954701 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:26:05.959692 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954704 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.954709 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954856 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954862 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954865 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954867 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954870 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954873 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954875 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954877 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954880 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954882 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954885 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954887 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954889 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 21:26:05.960051 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954892 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954894 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954897 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954899 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954902 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954904 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954906 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954909 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954911 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954913 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954916 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954919 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954921 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954925 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954927 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954936 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954939 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954941 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954944 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 21:26:05.960420 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954946 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954948 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954951 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954953 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954956 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954958 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954960 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954963 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954965 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954968 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954970 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954972 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954975 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954977 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954979 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954982 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954984 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954986 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954989 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954991 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 21:26:05.960884 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954994 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.954997 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955000 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955003 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955006 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955009 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955012 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955015 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955017 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955025 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955028 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955031 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955033 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955036 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955038 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955041 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955043 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955046 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955048 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 21:26:05.961357 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955050 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955054 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955057 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955060 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955063 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955065 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955067 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955070 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955074 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955077 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955080 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955083 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955086 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955088 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955090 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955093 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955095 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955097 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955100 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 21:26:05.961829 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955103 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955105 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955108 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955110 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955119 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955121 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955124 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955127 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:05.955129 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.955134 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.955277 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.958816 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.960338 2576 server.go:1019] "Starting client certificate rotation" Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.960447 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 21:26:05.962278 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.960492 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 21:26:05.963341 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.963327 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 21:26:05.968655 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.968615 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 21:26:05.975201 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.975185 2576 log.go:25] "Validated CRI v1 runtime API" Jul 23 21:26:05.978198 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.978186 2576 log.go:25] "Validated CRI v1 image API" Jul 23 21:26:05.979037 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.979019 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 21:26:05.983906 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.983883 2576 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8531a1a5-cf1c-4f40-b4a3-f4f564052a7d:/dev/nvme0n1p3 ec5d91ee-6831-44fd-a31b-4cefbd889e2d:/dev/nvme0n1p4] Jul 23 21:26:05.983979 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.983905 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 21:26:05.989640 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.989527 2576 manager.go:216] Machine: {Timestamp:2026-07-23 21:26:05.988193847 +0000 UTC m=+0.354884106 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101466 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec205c557a286dc0a9da1f72c2cecb8e SystemUUID:ec205c55-7a28-6dc0-a9da-1f72c2cecb8e BootID:f54f241e-1165-4d66-8929-90682419a24e Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:62:e6:48:0c:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:62:e6:48:0c:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:5d:ee:a9:46:76 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 21:26:05.989640 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.989639 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 21:26:05.989752 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.989709 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 21:26:05.994325 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.994297 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 21:26:05.994464 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.994328 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 21:26:05.995688 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.995677 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 21:26:05.995731 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.995690 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 21:26:05.995731 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.995697 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 21:26:05.996129 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.996114 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 21:26:05.996445 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.996433 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 21:26:05.997745 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:05.997735 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 21:26:06.000771 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.000759 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 23 21:26:06.000887 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.000877 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 21:26:06.000924 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.000907 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 23 21:26:06.000924 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.000919 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 21:26:06.000981 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.000943 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 21:26:06.000981 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.000957 2576 kubelet.go:398] "Adding apiserver pod source" Jul 23 21:26:06.000981 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.000970 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 21:26:06.001458 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.001446 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 21:26:06.001511 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.001465 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 21:26:06.004705 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.004679 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 21:26:06.006564 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.006551 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 21:26:06.006619 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.006582 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 21:26:06.009309 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.009204 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 21:26:06.009692 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.009676 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 21:26:06.009758 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.009697 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 21:26:06.009758 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.009709 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 21:26:06.009758 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.009724 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 21:26:06.009758 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.009733 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 21:26:06.009758 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.009745 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 21:26:06.009758 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.009754 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 21:26:06.009986 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.009766 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 21:26:06.009986 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.009783 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 21:26:06.009986 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.009814 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 21:26:06.009986 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.009826 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 21:26:06.010650 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.010615 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 21:26:06.010650 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.010649 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 21:26:06.013071 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.013051 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 21:26:06.013151 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.013097 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 21:26:06.013151 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.013143 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 21:26:06.014304 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.014292 2576 server.go:1268] "Started kubelet" Jul 23 21:26:06.014429 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.014398 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 21:26:06.014493 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.014429 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 21:26:06.014493 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.014457 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 21:26:06.015196 ip-10-0-134-221 systemd[1]: Started Kubernetes Kubelet. Jul 23 21:26:06.015570 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.015550 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9th48" Jul 23 21:26:06.016453 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.016429 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 21:26:06.016787 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.016774 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 23 21:26:06.020682 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.019768 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-221.ec2.internal.18c5084fc47d684c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-221.ec2.internal,UID:ip-10-0-134-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-221.ec2.internal,},FirstTimestamp:2026-07-23 21:26:06.014261324 +0000 UTC m=+0.380951579,LastTimestamp:2026-07-23 21:26:06.014261324 +0000 UTC m=+0.380951579,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-221.ec2.internal,}" Jul 23 21:26:06.021199 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.021172 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 21:26:06.023207 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.023193 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 21:26:06.023285 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.023194 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 21:26:06.023340 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.023294 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 23 21:26:06.023606 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.023583 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9th48" Jul 23 21:26:06.023850 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.023832 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 21:26:06.023923 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.023832 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 21:26:06.023974 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.023929 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 21:26:06.024082 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.024050 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 23 21:26:06.024082 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.024064 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 23 21:26:06.024367 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.024354 2576 factory.go:153] Registering CRI-O factory Jul 23 21:26:06.024433 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.024371 2576 factory.go:223] Registration of the crio container factory successfully Jul 23 21:26:06.024433 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.024420 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 21:26:06.024433 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.024430 2576 factory.go:55] Registering systemd factory Jul 23 21:26:06.024534 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.024439 2576 factory.go:223] Registration of the systemd container factory successfully Jul 23 21:26:06.024534 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.024456 2576 factory.go:103] Registering Raw factory Jul 23 21:26:06.024534 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.024465 2576 manager.go:1196] Started watching for new ooms in manager Jul 23 21:26:06.025091 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.025077 2576 manager.go:349] Starting recovery of all containers Jul 23 21:26:06.033227 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.033065 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:06.035441 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.035415 2576 manager.go:354] Recovery completed Jul 23 21:26:06.036010 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.035989 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-221.ec2.internal\" not found" node="ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.041158 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.041146 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:06.043153 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.043132 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:06.043222 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.043171 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:06.043222 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.043183 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:06.043777 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.043759 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 21:26:06.043777 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.043774 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 21:26:06.043927 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.043778 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:06.043927 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.043789 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 23 21:26:06.044444 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.044427 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:06.044508 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.044452 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:06.044508 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.044461 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:06.045037 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.045025 2576 policy_none.go:49] "None policy: Start" Jul 23 21:26:06.045071 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.045042 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 21:26:06.045071 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.045052 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 21:26:06.046207 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.046197 2576 policy_none.go:47] "Start" Jul 23 21:26:06.091102 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.091088 2576 manager.go:337] "Starting Device Plugin manager" Jul 23 21:26:06.091190 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.091118 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 21:26:06.091190 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.091127 2576 server.go:87] "Starting device plugin registration server" Jul 23 21:26:06.091380 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.091364 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 21:26:06.091477 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.091383 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 21:26:06.091544 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.091461 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 21:26:06.091593 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.091583 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 21:26:06.091660 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.091593 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 21:26:06.092124 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.092103 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 21:26:06.092213 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.092150 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-221.ec2.internal\" not found" Jul 23 21:26:06.191852 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.191782 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:06.193180 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.193079 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:06.193180 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.193110 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:06.193180 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.193121 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:06.193180 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.193148 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.202442 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.202421 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.202544 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.202446 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-221.ec2.internal\": node \"ip-10-0-134-221.ec2.internal\" not found" Jul 23 21:26:06.202808 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.202784 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 21:26:06.204308 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.204293 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 21:26:06.204396 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.204336 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 21:26:06.204396 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.204362 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 21:26:06.204492 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.204399 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 21:26:06.206809 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.206791 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:06.235333 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.235317 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 23 21:26:06.305474 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.305438 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal"] Jul 23 21:26:06.305576 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.305538 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:06.306562 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.306546 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:06.306661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.306578 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:06.306661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.306593 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:06.308426 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.308413 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:06.308549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.308536 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.308589 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.308571 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:06.309164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.309151 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:06.309254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.309165 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:06.309254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.309190 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:06.309254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.309201 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:06.309254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.309170 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:06.309438 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.309283 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:06.310642 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.310613 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.310705 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.310654 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 21:26:06.311280 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.311256 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientMemory" Jul 23 21:26:06.311280 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.311280 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 21:26:06.311375 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.311294 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeHasSufficientPID" Jul 23 21:26:06.335917 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.335895 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 23 21:26:06.345347 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.345330 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-221.ec2.internal\" not found" node="ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.349960 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.349942 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-221.ec2.internal\" not found" node="ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.425228 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.425199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/754f38808a1cec3c2dcc8bdd9c8de63a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"754f38808a1cec3c2dcc8bdd9c8de63a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.425228 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.425228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/754f38808a1cec3c2dcc8bdd9c8de63a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"754f38808a1cec3c2dcc8bdd9c8de63a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.425386 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.425245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/647c551053bf7872d88b0557b63ff6dd-config\") pod \"kube-apiserver-proxy-ip-10-0-134-221.ec2.internal\" (UID: \"647c551053bf7872d88b0557b63ff6dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.436283 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.436260 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 23 21:26:06.525947 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.525863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/754f38808a1cec3c2dcc8bdd9c8de63a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"754f38808a1cec3c2dcc8bdd9c8de63a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.525947 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.525910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/754f38808a1cec3c2dcc8bdd9c8de63a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"754f38808a1cec3c2dcc8bdd9c8de63a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.525947 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.525938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/647c551053bf7872d88b0557b63ff6dd-config\") pod \"kube-apiserver-proxy-ip-10-0-134-221.ec2.internal\" (UID: \"647c551053bf7872d88b0557b63ff6dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.526112 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.525962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/754f38808a1cec3c2dcc8bdd9c8de63a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"754f38808a1cec3c2dcc8bdd9c8de63a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.526112 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.525972 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/647c551053bf7872d88b0557b63ff6dd-config\") pod \"kube-apiserver-proxy-ip-10-0-134-221.ec2.internal\" (UID: \"647c551053bf7872d88b0557b63ff6dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.526112 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.525972 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/754f38808a1cec3c2dcc8bdd9c8de63a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal\" (UID: \"754f38808a1cec3c2dcc8bdd9c8de63a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.536964 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.536946 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 23 21:26:06.637479 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.637442 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 23 21:26:06.648567 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.648544 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.653510 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:06.653497 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" Jul 23 21:26:06.737703 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.737670 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 23 21:26:06.838262 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:06.838197 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-221.ec2.internal\" not found" Jul 23 21:26:07.962031 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:07.962004 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:07.962936 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:07.962923 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" Jul 23 21:26:07.973508 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:07.973486 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 21:26:07.975415 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:07.975402 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" Jul 23 21:26:07.985669 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:07.985653 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 21:26:07.998891 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:07.998874 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 21:26:07.999028 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:07.999004 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 21:26:07.999073 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:07.999008 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 21:26:07.999073 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:07.999013 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 21:26:08.041181 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.041158 2576 apiserver.go:52] "Watching apiserver" Jul 23 21:26:08.056957 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.056937 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 21:26:08.057379 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.057359 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-4fbxr","openshift-network-diagnostics/network-check-target-2j5g9","openshift-network-operator/iptables-alerter-mrfth","openshift-ovn-kubernetes/ovnkube-node-k5j52","kube-system/global-pull-secret-syncer-fphrs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb","openshift-dns/node-resolver-qzzbv","openshift-image-registry/node-ca-8s2x6","openshift-multus/multus-tnq6d","openshift-multus/network-metrics-daemon-f27wm","kube-system/konnectivity-agent-db8zd","kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal","openshift-cluster-node-tuning-operator/tuned-85kk9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal"] Jul 23 21:26:08.060230 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.060208 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.061810 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.061788 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:08.061915 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.061885 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:08.062401 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.062342 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 21:26:08.062680 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.062658 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 21:26:08.062767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.062678 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 21:26:08.062767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.062714 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 21:26:08.062767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.062738 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 21:26:08.062920 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.062799 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lt7pt\"" Jul 23 21:26:08.062920 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.062836 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 21:26:08.063112 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.063097 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mrfth" Jul 23 21:26:08.064507 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.064490 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.065740 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.065725 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 21:26:08.065824 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.065757 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:26:08.065883 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.065760 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 21:26:08.065959 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.065943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:08.066042 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.066021 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:08.066238 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066225 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-54t6f\"" Jul 23 21:26:08.066497 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066464 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 21:21:07 +0000 UTC" deadline="2028-01-03 09:44:19.378440045 +0000 UTC" Jul 23 21:26:08.066533 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066498 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12684h18m11.311944373s" Jul 23 21:26:08.066674 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066617 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 21:26:08.066792 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-cni-binary-copy\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.066792 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v29xb\"" Jul 23 21:26:08.066792 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.066792 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066715 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2gfm\" (UniqueName: \"kubernetes.io/projected/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-kube-api-access-m2gfm\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.066792 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cce2bdff-f3f2-4cf8-94f8-c97d3952c2da-iptables-alerter-script\") pod \"iptables-alerter-mrfth\" (UID: \"cce2bdff-f3f2-4cf8-94f8-c97d3952c2da\") " pod="openshift-network-operator/iptables-alerter-mrfth" Jul 23 21:26:08.066792 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cce2bdff-f3f2-4cf8-94f8-c97d3952c2da-host-slash\") pod \"iptables-alerter-mrfth\" (UID: \"cce2bdff-f3f2-4cf8-94f8-c97d3952c2da\") " pod="openshift-network-operator/iptables-alerter-mrfth" Jul 23 21:26:08.067060 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066816 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.067060 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k285h\" (UniqueName: \"kubernetes.io/projected/cce2bdff-f3f2-4cf8-94f8-c97d3952c2da-kube-api-access-k285h\") pod \"iptables-alerter-mrfth\" (UID: \"cce2bdff-f3f2-4cf8-94f8-c97d3952c2da\") " pod="openshift-network-operator/iptables-alerter-mrfth" Jul 23 21:26:08.067060 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-os-release\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.067060 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.067060 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5w8z\" (UniqueName: \"kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z\") pod \"network-check-target-2j5g9\" (UID: \"711592be-4119-4571-a772-0e266a2f6571\") " pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:08.067060 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.066976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-system-cni-dir\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.067060 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.067003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-cnibin\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.067310 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.067296 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.067824 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.067660 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 21:26:08.067824 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.067667 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 21:26:08.067824 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.067689 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 21:26:08.067824 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.067719 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 21:26:08.067824 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.067802 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 21:26:08.068666 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.068650 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qzzbv" Jul 23 21:26:08.069264 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.069251 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 21:26:08.069447 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.069435 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 21:26:08.069752 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.069736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4zm6m\"" Jul 23 21:26:08.070065 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.070050 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 21:26:08.070130 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.070094 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8s2x6" Jul 23 21:26:08.070731 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.070713 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 21:26:08.070810 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.070746 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 21:26:08.070864 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.070845 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5kxb8\"" Jul 23 21:26:08.071550 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.071536 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.072050 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.072033 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5j4qf\"" Jul 23 21:26:08.072133 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.072085 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 21:26:08.072466 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.072444 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 21:26:08.072580 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.072471 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 21:26:08.073664 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.073644 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:08.073749 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.073646 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mzpvs\"" Jul 23 21:26:08.073975 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.073955 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 21:26:08.074057 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.073984 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:08.074693 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.074677 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 21:26:08.075229 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.075211 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-db8zd" Jul 23 21:26:08.076925 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.076911 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.077402 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.077390 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z46xs\"" Jul 23 21:26:08.077606 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.077592 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 21:26:08.077678 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.077649 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 21:26:08.079576 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.079557 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:26:08.079768 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.079747 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 21:26:08.079848 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.079831 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s9qjd\"" Jul 23 21:26:08.096559 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.096536 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-slpc2" Jul 23 21:26:08.104054 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.104037 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-slpc2" Jul 23 21:26:08.163748 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.163545 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 21:26:08.167284 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-socket-dir\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.167379 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-var-lib-kubelet\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.167379 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v4n8\" (UniqueName: \"kubernetes.io/projected/b9409491-2cad-428b-88f1-dad4fc3ec65b-kube-api-access-4v4n8\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.167379 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/990c00b8-e5ad-4b21-bf34-c12b41718ef6-agent-certs\") pod \"konnectivity-agent-db8zd\" (UID: \"990c00b8-e5ad-4b21-bf34-c12b41718ef6\") " pod="kube-system/konnectivity-agent-db8zd" Jul 23 21:26:08.167527 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cce2bdff-f3f2-4cf8-94f8-c97d3952c2da-host-slash\") pod \"iptables-alerter-mrfth\" (UID: \"cce2bdff-f3f2-4cf8-94f8-c97d3952c2da\") " pod="openshift-network-operator/iptables-alerter-mrfth" Jul 23 21:26:08.167527 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167431 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01dab5b8-48b4-4745-8526-c822fa9110a2-env-overrides\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.167527 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167462 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cce2bdff-f3f2-4cf8-94f8-c97d3952c2da-host-slash\") pod \"iptables-alerter-mrfth\" (UID: \"cce2bdff-f3f2-4cf8-94f8-c97d3952c2da\") " pod="openshift-network-operator/iptables-alerter-mrfth" Jul 23 21:26:08.167527 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v5tq\" (UniqueName: \"kubernetes.io/projected/a7c3140f-42f4-4305-a9de-0f4ab5240702-kube-api-access-5v5tq\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:08.167684 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-run-ovn-kubernetes\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.167684 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-sysconfig\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.167684 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-var-lib-kubelet\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.167684 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-node-log\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.167684 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.167684 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01dab5b8-48b4-4745-8526-c822fa9110a2-ovnkube-script-lib\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.167684 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9ql5\" (UniqueName: \"kubernetes.io/projected/01dab5b8-48b4-4745-8526-c822fa9110a2-kube-api-access-g9ql5\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.167944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-cnibin\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.167944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-multus-conf-dir\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.167944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/990c00b8-e5ad-4b21-bf34-c12b41718ef6-konnectivity-ca\") pod \"konnectivity-agent-db8zd\" (UID: \"990c00b8-e5ad-4b21-bf34-c12b41718ef6\") " pod="kube-system/konnectivity-agent-db8zd" Jul 23 21:26:08.167944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4c019a8-492c-4736-9e54-0289503edc1e-dbus\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:08.167944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:08.167944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-slash\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.167944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhm4r\" (UniqueName: \"kubernetes.io/projected/87ff3137-7154-47f6-9d0e-493d92623c28-kube-api-access-dhm4r\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.167944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f16ca22b-c9f7-4d03-bd6c-b8e38a72777e-host\") pod \"node-ca-8s2x6\" (UID: \"f16ca22b-c9f7-4d03-bd6c-b8e38a72777e\") " pod="openshift-image-registry/node-ca-8s2x6" Jul 23 21:26:08.167944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp2wz\" (UniqueName: \"kubernetes.io/projected/f16ca22b-c9f7-4d03-bd6c-b8e38a72777e-kube-api-access-mp2wz\") pod \"node-ca-8s2x6\" (UID: \"f16ca22b-c9f7-4d03-bd6c-b8e38a72777e\") " pod="openshift-image-registry/node-ca-8s2x6" Jul 23 21:26:08.167944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dd834fa-cfaf-4978-8827-e8885dde51fc-tmp-dir\") pod \"node-resolver-qzzbv\" (UID: \"9dd834fa-cfaf-4978-8827-e8885dde51fc\") " pod="openshift-dns/node-resolver-qzzbv" Jul 23 21:26:08.167944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01dab5b8-48b4-4745-8526-c822fa9110a2-ovn-node-metrics-cert\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.167944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f16ca22b-c9f7-4d03-bd6c-b8e38a72777e-serviceca\") pod \"node-ca-8s2x6\" (UID: \"f16ca22b-c9f7-4d03-bd6c-b8e38a72777e\") " pod="openshift-image-registry/node-ca-8s2x6" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-multus-socket-dir-parent\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-run-netns\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.167985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-hostroot\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-etc-kubernetes\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168015 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-sysctl-conf\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5w8z\" (UniqueName: \"kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z\") pod \"network-check-target-2j5g9\" (UID: \"711592be-4119-4571-a772-0e266a2f6571\") " pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4c019a8-492c-4736-9e54-0289503edc1e-kubelet-config\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-systemd-units\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-device-dir\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-sys-fs\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168126 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-var-lib-cni-bin\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168150 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-run\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-sys\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-system-cni-dir\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-kubelet\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168214 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-etc-openvswitch\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.168389 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-modprobe-d\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-lib-modules\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168271 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-system-cni-dir\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-tuned\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cce2bdff-f3f2-4cf8-94f8-c97d3952c2da-iptables-alerter-script\") pod \"iptables-alerter-mrfth\" (UID: \"cce2bdff-f3f2-4cf8-94f8-c97d3952c2da\") " pod="openshift-network-operator/iptables-alerter-mrfth" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168353 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-run-openvswitch\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-run-ovn\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-cni-bin\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n42qv\" (UniqueName: \"kubernetes.io/projected/89acf8e9-7306-40b8-8bc1-9d3aff799648-kube-api-access-n42qv\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-kubernetes\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-registration-dir\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k285h\" (UniqueName: \"kubernetes.io/projected/cce2bdff-f3f2-4cf8-94f8-c97d3952c2da-kube-api-access-k285h\") pod \"iptables-alerter-mrfth\" (UID: \"cce2bdff-f3f2-4cf8-94f8-c97d3952c2da\") " pod="openshift-network-operator/iptables-alerter-mrfth" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-run-systemd\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-cni-netd\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-os-release\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-os-release\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.169195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-system-cni-dir\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-multus-cni-dir\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168758 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89acf8e9-7306-40b8-8bc1-9d3aff799648-cni-binary-copy\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168769 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-os-release\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168776 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cce2bdff-f3f2-4cf8-94f8-c97d3952c2da-iptables-alerter-script\") pod \"iptables-alerter-mrfth\" (UID: \"cce2bdff-f3f2-4cf8-94f8-c97d3952c2da\") " pod="openshift-network-operator/iptables-alerter-mrfth" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-var-lib-cni-multus\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-run-multus-certs\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-cnibin\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-cni-binary-copy\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gfm\" (UniqueName: \"kubernetes.io/projected/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-kube-api-access-m2gfm\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168877 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-cnibin\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-run-netns\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9409491-2cad-428b-88f1-dad4fc3ec65b-tmp\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.168987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-var-lib-openvswitch\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169018 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-etc-selinux\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-systemd\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.169823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-log-socket\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01dab5b8-48b4-4745-8526-c822fa9110a2-ovnkube-config\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-run-k8s-cni-cncf-io\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-sysctl-d\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9dd834fa-cfaf-4978-8827-e8885dde51fc-hosts-file\") pod \"node-resolver-qzzbv\" (UID: \"9dd834fa-cfaf-4978-8827-e8885dde51fc\") " pod="openshift-dns/node-resolver-qzzbv" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/89acf8e9-7306-40b8-8bc1-9d3aff799648-multus-daemon-config\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-host\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169325 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-cni-binary-copy\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169340 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l4k9\" (UniqueName: \"kubernetes.io/projected/9dd834fa-cfaf-4978-8827-e8885dde51fc-kube-api-access-9l4k9\") pod \"node-resolver-qzzbv\" (UID: \"9dd834fa-cfaf-4978-8827-e8885dde51fc\") " pod="openshift-dns/node-resolver-qzzbv" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169518 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.170335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.169658 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.173883 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.173842 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:08.173883 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.173872 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:08.173883 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.173885 2576 projected.go:196] Error preparing data for projected volume kube-api-access-f5w8z for pod openshift-network-diagnostics/network-check-target-2j5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:08.174226 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.173959 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z podName:711592be-4119-4571-a772-0e266a2f6571 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:08.673938955 +0000 UTC m=+2.001627665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f5w8z" (UniqueName: "kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z") pod "network-check-target-2j5g9" (UID: "711592be-4119-4571-a772-0e266a2f6571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:08.174471 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.174443 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 21:26:08.177361 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.177335 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k285h\" (UniqueName: \"kubernetes.io/projected/cce2bdff-f3f2-4cf8-94f8-c97d3952c2da-kube-api-access-k285h\") pod \"iptables-alerter-mrfth\" (UID: \"cce2bdff-f3f2-4cf8-94f8-c97d3952c2da\") " pod="openshift-network-operator/iptables-alerter-mrfth" Jul 23 21:26:08.177361 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.177349 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2gfm\" (UniqueName: \"kubernetes.io/projected/c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b-kube-api-access-m2gfm\") pod \"multus-additional-cni-plugins-4fbxr\" (UID: \"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b\") " pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.261710 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:08.261678 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754f38808a1cec3c2dcc8bdd9c8de63a.slice/crio-1a3bb11b12f321375bba4b8e3b475489de4362784f34d84021dd92757bf45a2d WatchSource:0}: Error finding container 1a3bb11b12f321375bba4b8e3b475489de4362784f34d84021dd92757bf45a2d: Status 404 returned error can't find the container with id 1a3bb11b12f321375bba4b8e3b475489de4362784f34d84021dd92757bf45a2d Jul 23 21:26:08.265847 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.265827 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 21:26:08.270093 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-sysctl-d\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.270163 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9dd834fa-cfaf-4978-8827-e8885dde51fc-hosts-file\") pod \"node-resolver-qzzbv\" (UID: \"9dd834fa-cfaf-4978-8827-e8885dde51fc\") " pod="openshift-dns/node-resolver-qzzbv" Jul 23 21:26:08.270163 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/89acf8e9-7306-40b8-8bc1-9d3aff799648-multus-daemon-config\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.270163 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-host\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.270163 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l4k9\" (UniqueName: \"kubernetes.io/projected/9dd834fa-cfaf-4978-8827-e8885dde51fc-kube-api-access-9l4k9\") pod \"node-resolver-qzzbv\" (UID: \"9dd834fa-cfaf-4978-8827-e8885dde51fc\") " pod="openshift-dns/node-resolver-qzzbv" Jul 23 21:26:08.270341 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.270341 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-socket-dir\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.270341 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9dd834fa-cfaf-4978-8827-e8885dde51fc-hosts-file\") pod \"node-resolver-qzzbv\" (UID: \"9dd834fa-cfaf-4978-8827-e8885dde51fc\") " pod="openshift-dns/node-resolver-qzzbv" Jul 23 21:26:08.270341 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-var-lib-kubelet\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.270341 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270224 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-host\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.270341 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v4n8\" (UniqueName: \"kubernetes.io/projected/b9409491-2cad-428b-88f1-dad4fc3ec65b-kube-api-access-4v4n8\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.270341 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/990c00b8-e5ad-4b21-bf34-c12b41718ef6-agent-certs\") pod \"konnectivity-agent-db8zd\" (UID: \"990c00b8-e5ad-4b21-bf34-c12b41718ef6\") " pod="kube-system/konnectivity-agent-db8zd" Jul 23 21:26:08.270341 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270266 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.270341 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270262 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-sysctl-d\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.270341 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270294 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-var-lib-kubelet\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270359 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-socket-dir\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01dab5b8-48b4-4745-8526-c822fa9110a2-env-overrides\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v5tq\" (UniqueName: \"kubernetes.io/projected/a7c3140f-42f4-4305-a9de-0f4ab5240702-kube-api-access-5v5tq\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-run-ovn-kubernetes\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-sysconfig\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-var-lib-kubelet\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-node-log\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270607 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-run-ovn-kubernetes\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01dab5b8-48b4-4745-8526-c822fa9110a2-ovnkube-script-lib\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ql5\" (UniqueName: \"kubernetes.io/projected/01dab5b8-48b4-4745-8526-c822fa9110a2-kube-api-access-g9ql5\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270709 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-var-lib-kubelet\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270719 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/89acf8e9-7306-40b8-8bc1-9d3aff799648-multus-daemon-config\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270759 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-sysconfig\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270766 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-node-log\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270774 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.270851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270716 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-cnibin\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270766 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-cnibin\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-multus-conf-dir\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/990c00b8-e5ad-4b21-bf34-c12b41718ef6-konnectivity-ca\") pod \"konnectivity-agent-db8zd\" (UID: \"990c00b8-e5ad-4b21-bf34-c12b41718ef6\") " pod="kube-system/konnectivity-agent-db8zd" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270959 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-multus-conf-dir\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.270975 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/01dab5b8-48b4-4745-8526-c822fa9110a2-env-overrides\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4c019a8-492c-4736-9e54-0289503edc1e-dbus\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-slash\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhm4r\" (UniqueName: \"kubernetes.io/projected/87ff3137-7154-47f6-9d0e-493d92623c28-kube-api-access-dhm4r\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.271213 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f16ca22b-c9f7-4d03-bd6c-b8e38a72777e-host\") pod \"node-ca-8s2x6\" (UID: \"f16ca22b-c9f7-4d03-bd6c-b8e38a72777e\") " pod="openshift-image-registry/node-ca-8s2x6" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp2wz\" (UniqueName: \"kubernetes.io/projected/f16ca22b-c9f7-4d03-bd6c-b8e38a72777e-kube-api-access-mp2wz\") pod \"node-ca-8s2x6\" (UID: \"f16ca22b-c9f7-4d03-bd6c-b8e38a72777e\") " pod="openshift-image-registry/node-ca-8s2x6" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.271268 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret podName:b4c019a8-492c-4736-9e54-0289503edc1e nodeName:}" failed. No retries permitted until 2026-07-23 21:26:08.771252138 +0000 UTC m=+2.098940853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret") pod "global-pull-secret-syncer-fphrs" (UID: "b4c019a8-492c-4736-9e54-0289503edc1e") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dd834fa-cfaf-4978-8827-e8885dde51fc-tmp-dir\") pod \"node-resolver-qzzbv\" (UID: \"9dd834fa-cfaf-4978-8827-e8885dde51fc\") " pod="openshift-dns/node-resolver-qzzbv" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271322 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01dab5b8-48b4-4745-8526-c822fa9110a2-ovn-node-metrics-cert\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f16ca22b-c9f7-4d03-bd6c-b8e38a72777e-serviceca\") pod \"node-ca-8s2x6\" (UID: \"f16ca22b-c9f7-4d03-bd6c-b8e38a72777e\") " pod="openshift-image-registry/node-ca-8s2x6" Jul 23 21:26:08.271704 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-multus-socket-dir-parent\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-run-netns\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-hostroot\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-etc-kubernetes\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-sysctl-conf\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271447 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/990c00b8-e5ad-4b21-bf34-c12b41718ef6-konnectivity-ca\") pod \"konnectivity-agent-db8zd\" (UID: \"990c00b8-e5ad-4b21-bf34-c12b41718ef6\") " pod="kube-system/konnectivity-agent-db8zd" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4c019a8-492c-4736-9e54-0289503edc1e-kubelet-config\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-systemd-units\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271507 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f16ca22b-c9f7-4d03-bd6c-b8e38a72777e-host\") pod \"node-ca-8s2x6\" (UID: \"f16ca22b-c9f7-4d03-bd6c-b8e38a72777e\") " pod="openshift-image-registry/node-ca-8s2x6" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271504 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-device-dir\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271549 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-device-dir\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-sys-fs\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-var-lib-cni-bin\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271588 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-run\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271593 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-sys-fs\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-sys\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-kubelet\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-etc-openvswitch\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.272512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271675 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-modprobe-d\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271693 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-lib-modules\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271702 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-var-lib-cni-bin\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-tuned\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-multus-socket-dir-parent\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271728 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-run-openvswitch\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-run-ovn\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271764 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-hostroot\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271770 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-slash\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271261 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4c019a8-492c-4736-9e54-0289503edc1e-dbus\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-cni-bin\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n42qv\" (UniqueName: \"kubernetes.io/projected/89acf8e9-7306-40b8-8bc1-9d3aff799648-kube-api-access-n42qv\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271828 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-sysctl-conf\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-kubernetes\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-registration-dir\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271901 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4c019a8-492c-4736-9e54-0289503edc1e-kubelet-config\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271153 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/01dab5b8-48b4-4745-8526-c822fa9110a2-ovnkube-script-lib\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.273554 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-run-systemd\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-cni-netd\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-systemd-units\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271977 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-run-openvswitch\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-os-release\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.271973 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-etc-kubernetes\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272021 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dd834fa-cfaf-4978-8827-e8885dde51fc-tmp-dir\") pod \"node-resolver-qzzbv\" (UID: \"9dd834fa-cfaf-4978-8827-e8885dde51fc\") " pod="openshift-dns/node-resolver-qzzbv" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272042 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-kubernetes\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272066 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-etc-openvswitch\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272100 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-os-release\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272114 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-run-ovn\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272130 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-lib-modules\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272142 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-modprobe-d\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272144 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-cni-bin\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272182 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-sys\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272194 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-run-netns\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.272214 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272214 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-kubelet\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272228 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-run-systemd\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.274491 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-system-cni-dir\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272291 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-registration-dir\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272301 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-multus-cni-dir\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89acf8e9-7306-40b8-8bc1-9d3aff799648-cni-binary-copy\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272342 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-run\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-var-lib-cni-multus\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272387 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-system-cni-dir\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-run-multus-certs\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272492 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-var-lib-cni-multus\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-run-netns\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272551 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9409491-2cad-428b-88f1-dad4fc3ec65b-tmp\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f16ca22b-c9f7-4d03-bd6c-b8e38a72777e-serviceca\") pod \"node-ca-8s2x6\" (UID: \"f16ca22b-c9f7-4d03-bd6c-b8e38a72777e\") " pod="openshift-image-registry/node-ca-8s2x6" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.272580 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs podName:a7c3140f-42f4-4305-a9de-0f4ab5240702 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:08.772561698 +0000 UTC m=+2.100250400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs") pod "network-metrics-daemon-f27wm" (UID: "a7c3140f-42f4-4305-a9de-0f4ab5240702") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272588 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-multus-cni-dir\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272625 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-cni-netd\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272653 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-run-multus-certs\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272676 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-host-run-netns\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.275164 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272705 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-var-lib-openvswitch\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272744 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-etc-selinux\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-systemd\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-log-socket\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272821 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-var-lib-openvswitch\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01dab5b8-48b4-4745-8526-c822fa9110a2-ovnkube-config\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/01dab5b8-48b4-4745-8526-c822fa9110a2-log-socket\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272910 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/89acf8e9-7306-40b8-8bc1-9d3aff799648-cni-binary-copy\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272935 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/87ff3137-7154-47f6-9d0e-493d92623c28-etc-selinux\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.272985 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-systemd\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.273130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-run-k8s-cni-cncf-io\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.273162 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/990c00b8-e5ad-4b21-bf34-c12b41718ef6-agent-certs\") pod \"konnectivity-agent-db8zd\" (UID: \"990c00b8-e5ad-4b21-bf34-c12b41718ef6\") " pod="kube-system/konnectivity-agent-db8zd" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.273210 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/89acf8e9-7306-40b8-8bc1-9d3aff799648-host-run-k8s-cni-cncf-io\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.273346 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/01dab5b8-48b4-4745-8526-c822fa9110a2-ovnkube-config\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.274165 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/01dab5b8-48b4-4745-8526-c822fa9110a2-ovn-node-metrics-cert\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.274480 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b9409491-2cad-428b-88f1-dad4fc3ec65b-etc-tuned\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.275624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.274958 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9409491-2cad-428b-88f1-dad4fc3ec65b-tmp\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.278825 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.278788 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v4n8\" (UniqueName: \"kubernetes.io/projected/b9409491-2cad-428b-88f1-dad4fc3ec65b-kube-api-access-4v4n8\") pod \"tuned-85kk9\" (UID: \"b9409491-2cad-428b-88f1-dad4fc3ec65b\") " pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.278932 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.278892 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l4k9\" (UniqueName: \"kubernetes.io/projected/9dd834fa-cfaf-4978-8827-e8885dde51fc-kube-api-access-9l4k9\") pod \"node-resolver-qzzbv\" (UID: \"9dd834fa-cfaf-4978-8827-e8885dde51fc\") " pod="openshift-dns/node-resolver-qzzbv" Jul 23 21:26:08.280468 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.280432 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v5tq\" (UniqueName: \"kubernetes.io/projected/a7c3140f-42f4-4305-a9de-0f4ab5240702-kube-api-access-5v5tq\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:08.280928 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.280911 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhm4r\" (UniqueName: \"kubernetes.io/projected/87ff3137-7154-47f6-9d0e-493d92623c28-kube-api-access-dhm4r\") pod \"aws-ebs-csi-driver-node-sc8qb\" (UID: \"87ff3137-7154-47f6-9d0e-493d92623c28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.281089 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.281073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp2wz\" (UniqueName: \"kubernetes.io/projected/f16ca22b-c9f7-4d03-bd6c-b8e38a72777e-kube-api-access-mp2wz\") pod \"node-ca-8s2x6\" (UID: \"f16ca22b-c9f7-4d03-bd6c-b8e38a72777e\") " pod="openshift-image-registry/node-ca-8s2x6" Jul 23 21:26:08.281952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.281927 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n42qv\" (UniqueName: \"kubernetes.io/projected/89acf8e9-7306-40b8-8bc1-9d3aff799648-kube-api-access-n42qv\") pod \"multus-tnq6d\" (UID: \"89acf8e9-7306-40b8-8bc1-9d3aff799648\") " pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.281952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.281942 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9ql5\" (UniqueName: \"kubernetes.io/projected/01dab5b8-48b4-4745-8526-c822fa9110a2-kube-api-access-g9ql5\") pod \"ovnkube-node-k5j52\" (UID: \"01dab5b8-48b4-4745-8526-c822fa9110a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.378110 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.378075 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4fbxr" Jul 23 21:26:08.386593 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:08.386546 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc894edd7_9d1b_4c9f_b4b0_9fd975c4a93b.slice/crio-7673a2a8bda82a292bf13e0834f27e045913fb31f32b9b6aaf2bb8d25953cd76 WatchSource:0}: Error finding container 7673a2a8bda82a292bf13e0834f27e045913fb31f32b9b6aaf2bb8d25953cd76: Status 404 returned error can't find the container with id 7673a2a8bda82a292bf13e0834f27e045913fb31f32b9b6aaf2bb8d25953cd76 Jul 23 21:26:08.400416 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:08.400394 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647c551053bf7872d88b0557b63ff6dd.slice/crio-0177faf41d0e04e84af60a71f94f5d931ce39467b03773576a12297fc1fb63cf WatchSource:0}: Error finding container 0177faf41d0e04e84af60a71f94f5d931ce39467b03773576a12297fc1fb63cf: Status 404 returned error can't find the container with id 0177faf41d0e04e84af60a71f94f5d931ce39467b03773576a12297fc1fb63cf Jul 23 21:26:08.406428 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.406411 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mrfth" Jul 23 21:26:08.412477 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.412454 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:08.413407 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:08.413391 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce2bdff_f3f2_4cf8_94f8_c97d3952c2da.slice/crio-b24aa45bd4413634cd75185106d64625eebfe1a9b79ac89df840ab7480e94ca9 WatchSource:0}: Error finding container b24aa45bd4413634cd75185106d64625eebfe1a9b79ac89df840ab7480e94ca9: Status 404 returned error can't find the container with id b24aa45bd4413634cd75185106d64625eebfe1a9b79ac89df840ab7480e94ca9 Jul 23 21:26:08.420989 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:08.420938 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01dab5b8_48b4_4745_8526_c822fa9110a2.slice/crio-f18a2288d12a8209d4a9846ff9ef19e949ce3fb1794da1167dfa2b235ccedad7 WatchSource:0}: Error finding container f18a2288d12a8209d4a9846ff9ef19e949ce3fb1794da1167dfa2b235ccedad7: Status 404 returned error can't find the container with id f18a2288d12a8209d4a9846ff9ef19e949ce3fb1794da1167dfa2b235ccedad7 Jul 23 21:26:08.422518 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.422499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" Jul 23 21:26:08.429602 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:08.429579 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ff3137_7154_47f6_9d0e_493d92623c28.slice/crio-2fa510a88c2b6ebfafc020a60b5d4a4c7515ccb3662baa0dda30adaf495b220f WatchSource:0}: Error finding container 2fa510a88c2b6ebfafc020a60b5d4a4c7515ccb3662baa0dda30adaf495b220f: Status 404 returned error can't find the container with id 2fa510a88c2b6ebfafc020a60b5d4a4c7515ccb3662baa0dda30adaf495b220f Jul 23 21:26:08.438580 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.438564 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qzzbv" Jul 23 21:26:08.445267 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.445247 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8s2x6" Jul 23 21:26:08.445466 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:08.445448 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd834fa_cfaf_4978_8827_e8885dde51fc.slice/crio-0a731386f6e9991cdcc23c5c8b2574ffee4678f7628e85f0f1788e44f7536c40 WatchSource:0}: Error finding container 0a731386f6e9991cdcc23c5c8b2574ffee4678f7628e85f0f1788e44f7536c40: Status 404 returned error can't find the container with id 0a731386f6e9991cdcc23c5c8b2574ffee4678f7628e85f0f1788e44f7536c40 Jul 23 21:26:08.452270 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:08.452250 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16ca22b_c9f7_4d03_bd6c_b8e38a72777e.slice/crio-5495415a9f33921f3c362b844b7301a4f08a1f5c3a5874bbcb684b8397053219 WatchSource:0}: Error finding container 5495415a9f33921f3c362b844b7301a4f08a1f5c3a5874bbcb684b8397053219: Status 404 returned error can't find the container with id 5495415a9f33921f3c362b844b7301a4f08a1f5c3a5874bbcb684b8397053219 Jul 23 21:26:08.483979 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.483950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tnq6d" Jul 23 21:26:08.490708 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:08.490690 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89acf8e9_7306_40b8_8bc1_9d3aff799648.slice/crio-1c67bc1235b7b77b9bad15e1fc63a284c27bc0d5c99661b4ea7b13d4245af1ce WatchSource:0}: Error finding container 1c67bc1235b7b77b9bad15e1fc63a284c27bc0d5c99661b4ea7b13d4245af1ce: Status 404 returned error can't find the container with id 1c67bc1235b7b77b9bad15e1fc63a284c27bc0d5c99661b4ea7b13d4245af1ce Jul 23 21:26:08.494397 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.494380 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:08.498663 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.498645 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-db8zd" Jul 23 21:26:08.504031 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.504010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-85kk9" Jul 23 21:26:08.505991 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:08.505970 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990c00b8_e5ad_4b21_bf34_c12b41718ef6.slice/crio-6a8a21697325294dec4a3782671425d6f3780f73a28e13b83bb829ffcf8e2f62 WatchSource:0}: Error finding container 6a8a21697325294dec4a3782671425d6f3780f73a28e13b83bb829ffcf8e2f62: Status 404 returned error can't find the container with id 6a8a21697325294dec4a3782671425d6f3780f73a28e13b83bb829ffcf8e2f62 Jul 23 21:26:08.510911 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:08.510891 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9409491_2cad_428b_88f1_dad4fc3ec65b.slice/crio-fdb9cb451e7b880e89630e74cac052f1613382f8731bf9cb6fa8b765c193309f WatchSource:0}: Error finding container fdb9cb451e7b880e89630e74cac052f1613382f8731bf9cb6fa8b765c193309f: Status 404 returned error can't find the container with id fdb9cb451e7b880e89630e74cac052f1613382f8731bf9cb6fa8b765c193309f Jul 23 21:26:08.676584 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.676500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5w8z\" (UniqueName: \"kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z\") pod \"network-check-target-2j5g9\" (UID: \"711592be-4119-4571-a772-0e266a2f6571\") " pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:08.676744 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.676690 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:08.676744 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.676709 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:08.676744 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.676724 2576 projected.go:196] Error preparing data for projected volume kube-api-access-f5w8z for pod openshift-network-diagnostics/network-check-target-2j5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:08.676900 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.676779 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z podName:711592be-4119-4571-a772-0e266a2f6571 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:09.676766946 +0000 UTC m=+3.004455660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5w8z" (UniqueName: "kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z") pod "network-check-target-2j5g9" (UID: "711592be-4119-4571-a772-0e266a2f6571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:08.777696 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.777660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:08.777888 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:08.777756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:08.777888 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.777857 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:08.777993 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.777885 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:08.777993 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.777941 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs podName:a7c3140f-42f4-4305-a9de-0f4ab5240702 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:09.777919632 +0000 UTC m=+3.105608338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs") pod "network-metrics-daemon-f27wm" (UID: "a7c3140f-42f4-4305-a9de-0f4ab5240702") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:08.777993 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:08.777961 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret podName:b4c019a8-492c-4736-9e54-0289503edc1e nodeName:}" failed. No retries permitted until 2026-07-23 21:26:09.7779515 +0000 UTC m=+3.105640203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret") pod "global-pull-secret-syncer-fphrs" (UID: "b4c019a8-492c-4736-9e54-0289503edc1e") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:09.105619 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.105527 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 21:21:08 +0000 UTC" deadline="2028-01-19 07:00:36.814309356 +0000 UTC" Jul 23 21:26:09.105619 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.105571 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13065h34m27.708743022s" Jul 23 21:26:09.244776 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.244747 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:09.244947 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:09.244889 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:09.245010 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.244944 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:09.245115 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:09.245088 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:09.257620 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.257563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" event={"ID":"754f38808a1cec3c2dcc8bdd9c8de63a","Type":"ContainerStarted","Data":"1a3bb11b12f321375bba4b8e3b475489de4362784f34d84021dd92757bf45a2d"} Jul 23 21:26:09.261198 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.261168 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-85kk9" event={"ID":"b9409491-2cad-428b-88f1-dad4fc3ec65b","Type":"ContainerStarted","Data":"fdb9cb451e7b880e89630e74cac052f1613382f8731bf9cb6fa8b765c193309f"} Jul 23 21:26:09.266203 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.266177 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qzzbv" event={"ID":"9dd834fa-cfaf-4978-8827-e8885dde51fc","Type":"ContainerStarted","Data":"0a731386f6e9991cdcc23c5c8b2574ffee4678f7628e85f0f1788e44f7536c40"} Jul 23 21:26:09.270195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.270166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fbxr" event={"ID":"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b","Type":"ContainerStarted","Data":"7673a2a8bda82a292bf13e0834f27e045913fb31f32b9b6aaf2bb8d25953cd76"} Jul 23 21:26:09.275147 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.275117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-db8zd" event={"ID":"990c00b8-e5ad-4b21-bf34-c12b41718ef6","Type":"ContainerStarted","Data":"6a8a21697325294dec4a3782671425d6f3780f73a28e13b83bb829ffcf8e2f62"} Jul 23 21:26:09.277406 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.277378 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tnq6d" event={"ID":"89acf8e9-7306-40b8-8bc1-9d3aff799648","Type":"ContainerStarted","Data":"1c67bc1235b7b77b9bad15e1fc63a284c27bc0d5c99661b4ea7b13d4245af1ce"} Jul 23 21:26:09.280950 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.280893 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8s2x6" event={"ID":"f16ca22b-c9f7-4d03-bd6c-b8e38a72777e","Type":"ContainerStarted","Data":"5495415a9f33921f3c362b844b7301a4f08a1f5c3a5874bbcb684b8397053219"} Jul 23 21:26:09.293597 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.293571 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" event={"ID":"87ff3137-7154-47f6-9d0e-493d92623c28","Type":"ContainerStarted","Data":"2fa510a88c2b6ebfafc020a60b5d4a4c7515ccb3662baa0dda30adaf495b220f"} Jul 23 21:26:09.302272 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.302246 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" event={"ID":"01dab5b8-48b4-4745-8526-c822fa9110a2","Type":"ContainerStarted","Data":"f18a2288d12a8209d4a9846ff9ef19e949ce3fb1794da1167dfa2b235ccedad7"} Jul 23 21:26:09.308571 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.307983 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:09.315243 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.315183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mrfth" event={"ID":"cce2bdff-f3f2-4cf8-94f8-c97d3952c2da","Type":"ContainerStarted","Data":"b24aa45bd4413634cd75185106d64625eebfe1a9b79ac89df840ab7480e94ca9"} Jul 23 21:26:09.326815 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.326790 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" event={"ID":"647c551053bf7872d88b0557b63ff6dd","Type":"ContainerStarted","Data":"0177faf41d0e04e84af60a71f94f5d931ce39467b03773576a12297fc1fb63cf"} Jul 23 21:26:09.470649 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.470553 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:09.687493 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.686875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5w8z\" (UniqueName: \"kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z\") pod \"network-check-target-2j5g9\" (UID: \"711592be-4119-4571-a772-0e266a2f6571\") " pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:09.687493 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:09.687070 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:09.687493 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:09.687095 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:09.687493 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:09.687108 2576 projected.go:196] Error preparing data for projected volume kube-api-access-f5w8z for pod openshift-network-diagnostics/network-check-target-2j5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:09.687493 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:09.687166 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z podName:711592be-4119-4571-a772-0e266a2f6571 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:11.687148226 +0000 UTC m=+5.014836922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5w8z" (UniqueName: "kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z") pod "network-check-target-2j5g9" (UID: "711592be-4119-4571-a772-0e266a2f6571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:09.787769 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.787685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:09.787934 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:09.787773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:09.787934 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:09.787922 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:09.788047 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:09.787990 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs podName:a7c3140f-42f4-4305-a9de-0f4ab5240702 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:11.787968646 +0000 UTC m=+5.115657364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs") pod "network-metrics-daemon-f27wm" (UID: "a7c3140f-42f4-4305-a9de-0f4ab5240702") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:09.788452 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:09.788429 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:09.788545 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:09.788505 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret podName:b4c019a8-492c-4736-9e54-0289503edc1e nodeName:}" failed. No retries permitted until 2026-07-23 21:26:11.788478318 +0000 UTC m=+5.116167038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret") pod "global-pull-secret-syncer-fphrs" (UID: "b4c019a8-492c-4736-9e54-0289503edc1e") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:10.106323 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:10.106198 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 21:21:08 +0000 UTC" deadline="2028-01-08 06:37:31.916891132 +0000 UTC" Jul 23 21:26:10.106323 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:10.106275 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12801h11m21.810621374s" Jul 23 21:26:10.243903 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:10.243863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:10.244071 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:10.244009 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:10.780294 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:10.780264 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 21:26:11.244416 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:11.244337 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:11.244859 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:11.244499 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:11.245063 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:11.245039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:11.245185 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:11.245160 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:11.703882 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:11.703751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5w8z\" (UniqueName: \"kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z\") pod \"network-check-target-2j5g9\" (UID: \"711592be-4119-4571-a772-0e266a2f6571\") " pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:11.704041 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:11.703928 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:11.704041 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:11.703944 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:11.704041 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:11.703953 2576 projected.go:196] Error preparing data for projected volume kube-api-access-f5w8z for pod openshift-network-diagnostics/network-check-target-2j5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:11.704041 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:11.704004 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z podName:711592be-4119-4571-a772-0e266a2f6571 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:15.703989328 +0000 UTC m=+9.031678024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5w8z" (UniqueName: "kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z") pod "network-check-target-2j5g9" (UID: "711592be-4119-4571-a772-0e266a2f6571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:11.805580 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:11.804314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:11.805580 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:11.804391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:11.805580 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:11.804517 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:11.805580 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:11.804578 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret podName:b4c019a8-492c-4736-9e54-0289503edc1e nodeName:}" failed. No retries permitted until 2026-07-23 21:26:15.804561074 +0000 UTC m=+9.132249773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret") pod "global-pull-secret-syncer-fphrs" (UID: "b4c019a8-492c-4736-9e54-0289503edc1e") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:11.805580 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:11.804981 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:11.805580 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:11.805030 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs podName:a7c3140f-42f4-4305-a9de-0f4ab5240702 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:15.805015142 +0000 UTC m=+9.132703841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs") pod "network-metrics-daemon-f27wm" (UID: "a7c3140f-42f4-4305-a9de-0f4ab5240702") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:12.244444 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:12.244410 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:12.244893 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:12.244556 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:13.245427 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:13.245393 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:13.245920 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:13.245500 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:13.245920 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:13.245885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:13.246002 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:13.245988 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:14.244614 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:14.244319 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:14.244614 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:14.244454 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:15.245165 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:15.244853 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:15.245616 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:15.245216 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:15.247312 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:15.247129 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:15.247312 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:15.247250 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:15.740768 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:15.740685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5w8z\" (UniqueName: \"kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z\") pod \"network-check-target-2j5g9\" (UID: \"711592be-4119-4571-a772-0e266a2f6571\") " pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:15.740923 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:15.740839 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:15.740923 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:15.740857 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:15.740923 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:15.740869 2576 projected.go:196] Error preparing data for projected volume kube-api-access-f5w8z for pod openshift-network-diagnostics/network-check-target-2j5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:15.741036 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:15.740933 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z podName:711592be-4119-4571-a772-0e266a2f6571 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:23.740915512 +0000 UTC m=+17.068604222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5w8z" (UniqueName: "kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z") pod "network-check-target-2j5g9" (UID: "711592be-4119-4571-a772-0e266a2f6571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:15.842279 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:15.841549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:15.842279 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:15.841643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:15.842279 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:15.841769 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:15.842279 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:15.841831 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs podName:a7c3140f-42f4-4305-a9de-0f4ab5240702 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:23.841812533 +0000 UTC m=+17.169501237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs") pod "network-metrics-daemon-f27wm" (UID: "a7c3140f-42f4-4305-a9de-0f4ab5240702") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:15.842279 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:15.841905 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:15.842279 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:15.841942 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret podName:b4c019a8-492c-4736-9e54-0289503edc1e nodeName:}" failed. No retries permitted until 2026-07-23 21:26:23.841930448 +0000 UTC m=+17.169619155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret") pod "global-pull-secret-syncer-fphrs" (UID: "b4c019a8-492c-4736-9e54-0289503edc1e") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:16.243587 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:16.243556 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:16.243764 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:16.243674 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:17.246392 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:17.246363 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:17.246869 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:17.246485 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:17.246928 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:17.246873 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:17.248009 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:17.246972 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:18.244604 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:18.244565 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:18.244804 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:18.244718 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:19.243623 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:19.243587 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:19.243992 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:19.243718 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:19.243992 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:19.243779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:19.243992 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:19.243888 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:20.243603 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:20.243570 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:20.243782 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:20.243692 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:21.244532 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:21.244499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:21.244532 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:21.244500 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:21.245058 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:21.244676 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:21.245058 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:21.244748 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:22.244262 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:22.244227 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:22.244442 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:22.244354 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:23.244403 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:23.244369 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:23.244897 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:23.244384 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:23.244897 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:23.244502 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:23.244897 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:23.244563 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:23.807108 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:23.807067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5w8z\" (UniqueName: \"kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z\") pod \"network-check-target-2j5g9\" (UID: \"711592be-4119-4571-a772-0e266a2f6571\") " pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:23.807291 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:23.807268 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:23.807341 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:23.807292 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:23.807341 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:23.807303 2576 projected.go:196] Error preparing data for projected volume kube-api-access-f5w8z for pod openshift-network-diagnostics/network-check-target-2j5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:23.807405 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:23.807359 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z podName:711592be-4119-4571-a772-0e266a2f6571 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:39.807345906 +0000 UTC m=+33.135034618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5w8z" (UniqueName: "kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z") pod "network-check-target-2j5g9" (UID: "711592be-4119-4571-a772-0e266a2f6571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:23.907612 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:23.907578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:23.907817 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:23.907657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:23.907817 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:23.907762 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:23.907817 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:23.907769 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:23.907934 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:23.907821 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs podName:a7c3140f-42f4-4305-a9de-0f4ab5240702 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:39.90780583 +0000 UTC m=+33.235494546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs") pod "network-metrics-daemon-f27wm" (UID: "a7c3140f-42f4-4305-a9de-0f4ab5240702") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:23.907934 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:23.907837 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret podName:b4c019a8-492c-4736-9e54-0289503edc1e nodeName:}" failed. No retries permitted until 2026-07-23 21:26:39.907829565 +0000 UTC m=+33.235518261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret") pod "global-pull-secret-syncer-fphrs" (UID: "b4c019a8-492c-4736-9e54-0289503edc1e") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:24.243836 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:24.243755 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:24.244025 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:24.243881 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:25.243794 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:25.243760 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:25.244196 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:25.243814 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:25.244196 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:25.243917 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:25.244196 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:25.244050 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:26.243948 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:26.243916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:26.244337 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:26.244035 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:27.245030 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:27.244993 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:27.245437 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:27.245116 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:27.245437 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:27.245174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:27.245437 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:27.245273 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:28.244313 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:28.244281 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:28.244488 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:28.244385 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:29.244424 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:29.244349 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:29.244873 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:29.244349 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:29.244873 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:29.244494 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:29.244873 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:29.244563 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:29.373766 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:29.373728 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tnq6d" event={"ID":"89acf8e9-7306-40b8-8bc1-9d3aff799648","Type":"ContainerStarted","Data":"8d445f07326576d251c278b8643a34c24ce54b848cc4a057f53f4affd3c8e7f7"} Jul 23 21:26:29.375383 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:29.375344 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" event={"ID":"647c551053bf7872d88b0557b63ff6dd","Type":"ContainerStarted","Data":"3484adda6cf0183d3a4de6a129fe4e9604ffda90bc3365cddafc82b52ab3ec39"} Jul 23 21:26:29.379124 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:29.379094 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-85kk9" event={"ID":"b9409491-2cad-428b-88f1-dad4fc3ec65b","Type":"ContainerStarted","Data":"6adf055d4e40fa3ab7b414cf8ecdd3bfca935e2f0e8a7ae66143d6c26d614ef9"} Jul 23 21:26:29.390663 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:29.390597 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tnq6d" podStartSLOduration=1.884059958 podStartE2EDuration="22.390584572s" totalImagesPullingTime="20.506524614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:29.390117743 +0000 UTC m=+22.717806461" watchObservedRunningTime="2026-07-23 21:26:29.390584572 +0000 UTC m=+22.718273297" Jul 23 21:26:29.403107 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:29.403066 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-221.ec2.internal" podStartSLOduration=22.403053015 podStartE2EDuration="22.403053015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:29.402459645 +0000 UTC m=+22.730148362" watchObservedRunningTime="2026-07-23 21:26:29.403053015 +0000 UTC m=+22.730741792" Jul 23 21:26:29.419102 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:29.419021 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-85kk9" podStartSLOduration=1.966273781 podStartE2EDuration="22.419002679s" totalImagesPullingTime="20.452728898s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:29.418731405 +0000 UTC m=+22.746420157" watchObservedRunningTime="2026-07-23 21:26:29.419002679 +0000 UTC m=+22.746691399" Jul 23 21:26:30.244174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.243875 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:30.244360 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:30.244252 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:30.382490 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.382402 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8s2x6" event={"ID":"f16ca22b-c9f7-4d03-bd6c-b8e38a72777e","Type":"ContainerStarted","Data":"4c63c26b201b4ed3c8365bfd85959d8b26f9224650099093c0bf73b61ea0d97b"} Jul 23 21:26:30.383979 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.383953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" event={"ID":"87ff3137-7154-47f6-9d0e-493d92623c28","Type":"ContainerStarted","Data":"037e684012db51457e5ec82c9922352fe2eb2f26f925c92864e3013c523a0028"} Jul 23 21:26:30.386749 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.386730 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5j52_01dab5b8-48b4-4745-8526-c822fa9110a2/ovn-acl-logging/0.log" Jul 23 21:26:30.387073 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.387054 2576 generic.go:356] "Generic (PLEG): container finished" podID="01dab5b8-48b4-4745-8526-c822fa9110a2" containerID="d36ebc2022c6c770230bd7ad392985a8e3d4d72255b34cfbb9b5ac77d0748dff" exitCode=1 Jul 23 21:26:30.387145 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.387115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" event={"ID":"01dab5b8-48b4-4745-8526-c822fa9110a2","Type":"ContainerStarted","Data":"414b1b2e0691f9452d2642b13ed474640740e299b1f28eabfc228a0504801e01"} Jul 23 21:26:30.387201 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.387165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" event={"ID":"01dab5b8-48b4-4745-8526-c822fa9110a2","Type":"ContainerStarted","Data":"e7b5abda8e5ef712a43a2f52e964f9a3060cd01c8e1dccd5efd464e0212df532"} Jul 23 21:26:30.387201 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.387196 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" event={"ID":"01dab5b8-48b4-4745-8526-c822fa9110a2","Type":"ContainerStarted","Data":"2fc13baee68368d8e24c1c9cb9bab2cd77e1e9d5caf69db34ec353dd3c74cdbe"} Jul 23 21:26:30.387298 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.387229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" event={"ID":"01dab5b8-48b4-4745-8526-c822fa9110a2","Type":"ContainerStarted","Data":"2598b17a9b0db655f03a71ac798542061b2c63bfed3c531f840aef140e8d7f25"} Jul 23 21:26:30.387298 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.387271 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" event={"ID":"01dab5b8-48b4-4745-8526-c822fa9110a2","Type":"ContainerDied","Data":"d36ebc2022c6c770230bd7ad392985a8e3d4d72255b34cfbb9b5ac77d0748dff"} Jul 23 21:26:30.387376 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.387307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" event={"ID":"01dab5b8-48b4-4745-8526-c822fa9110a2","Type":"ContainerStarted","Data":"b1937a6229b6dad448a88675097830235cff580c27888bcb89f1ae8153b599b2"} Jul 23 21:26:30.388465 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.388449 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mrfth" event={"ID":"cce2bdff-f3f2-4cf8-94f8-c97d3952c2da","Type":"ContainerStarted","Data":"0cd22288bc4218084ec628d1b3c59c0476abc4a1390ed24358d8bdafe36b1509"} Jul 23 21:26:30.389842 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.389823 2576 generic.go:356] "Generic (PLEG): container finished" podID="754f38808a1cec3c2dcc8bdd9c8de63a" containerID="26b78965d1f1cfdd0da5b10cf47b10602462c3d144b51e1c608eb91a699384ca" exitCode=0 Jul 23 21:26:30.389956 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.389893 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" event={"ID":"754f38808a1cec3c2dcc8bdd9c8de63a","Type":"ContainerDied","Data":"26b78965d1f1cfdd0da5b10cf47b10602462c3d144b51e1c608eb91a699384ca"} Jul 23 21:26:30.391224 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.391207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qzzbv" event={"ID":"9dd834fa-cfaf-4978-8827-e8885dde51fc","Type":"ContainerStarted","Data":"d9c3ac44c5b518706643fa17598a44b3e1ab1d6c24c5aafd3008abe4caf0e7fd"} Jul 23 21:26:30.392615 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.392597 2576 generic.go:356] "Generic (PLEG): container finished" podID="c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b" containerID="23d714ea31a002755621c7336b1e549b89c36e70a25a87b8e0a476e41a0d6651" exitCode=0 Jul 23 21:26:30.392708 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.392657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fbxr" event={"ID":"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b","Type":"ContainerDied","Data":"23d714ea31a002755621c7336b1e549b89c36e70a25a87b8e0a476e41a0d6651"} Jul 23 21:26:30.393973 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.393950 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-db8zd" event={"ID":"990c00b8-e5ad-4b21-bf34-c12b41718ef6","Type":"ContainerStarted","Data":"5d2e67ecfd1a8a92e050dd2b778267efd4ee4605c278988f593d5bcf1136a72e"} Jul 23 21:26:30.397800 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.397765 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8s2x6" podStartSLOduration=2.9886446209999997 podStartE2EDuration="23.397753658s" totalImagesPullingTime="20.409109037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:30.39757669 +0000 UTC m=+23.725265408" watchObservedRunningTime="2026-07-23 21:26:30.397753658 +0000 UTC m=+23.725442376" Jul 23 21:26:30.411088 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.411040 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qzzbv" podStartSLOduration=2.893465702 podStartE2EDuration="23.411027s" totalImagesPullingTime="20.517561298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:30.410666666 +0000 UTC m=+23.738355397" watchObservedRunningTime="2026-07-23 21:26:30.411027 +0000 UTC m=+23.738715719" Jul 23 21:26:30.448693 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.448623 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-db8zd" podStartSLOduration=3.061579349 podStartE2EDuration="23.448604796s" totalImagesPullingTime="20.387025447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:30.428234254 +0000 UTC m=+23.755922971" watchObservedRunningTime="2026-07-23 21:26:30.448604796 +0000 UTC m=+23.776293575" Jul 23 21:26:30.461828 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.461792 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mrfth" podStartSLOduration=11.40431202 podStartE2EDuration="23.461778543s" totalImagesPullingTime="12.057466523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:30.461322005 +0000 UTC m=+23.789010722" watchObservedRunningTime="2026-07-23 21:26:30.461778543 +0000 UTC m=+23.789467262" Jul 23 21:26:30.478495 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.478466 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:30.570979 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.570949 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-db8zd" Jul 23 21:26:30.571571 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.571546 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-db8zd" Jul 23 21:26:30.584616 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.584588 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:30.687797 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.687723 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:30.748639 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:30.748607 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:31.196302 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:31.196271 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 21:26:31.244038 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:31.244010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:31.244194 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:31.244054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:31.244194 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:31.244158 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:31.244306 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:31.244287 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:31.398752 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:31.398662 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" event={"ID":"87ff3137-7154-47f6-9d0e-493d92623c28","Type":"ContainerStarted","Data":"fe54fa83529c830d92ba4d214b6fa1c1bd3e4711f64597aa62941c00fba4b836"} Jul 23 21:26:31.399576 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:31.399469 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-db8zd" Jul 23 21:26:31.399886 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:31.399867 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-db8zd" Jul 23 21:26:31.500287 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:31.500251 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:32.143957 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:32.143850 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T21:26:31.196290983Z","UUID":"18777579-2840-44c4-b87a-c1f40f25bb89","Handler":null,"Name":"","Endpoint":""} Jul 23 21:26:32.145739 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:32.145715 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 21:26:32.145864 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:32.145761 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 21:26:32.244292 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:32.244260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:32.244458 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:32.244401 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:32.405615 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:32.405539 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5j52_01dab5b8-48b4-4745-8526-c822fa9110a2/ovn-acl-logging/0.log" Jul 23 21:26:32.406080 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:32.406046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" event={"ID":"01dab5b8-48b4-4745-8526-c822fa9110a2","Type":"ContainerStarted","Data":"f0060ef64d5aebe42a5aefdcd9220c16ad11db7c0bc2d3528dfeda7e15285af9"} Jul 23 21:26:32.409061 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:32.409020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" event={"ID":"754f38808a1cec3c2dcc8bdd9c8de63a","Type":"ContainerStarted","Data":"55d8d6ac45214a8abe76eb67b715e2a505e1c90f0ad48e9eaace8aedc45e86c7"} Jul 23 21:26:32.429842 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:32.429794 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-221.ec2.internal" podStartSLOduration=25.429778236 podStartE2EDuration="25.429778236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:32.4290538 +0000 UTC m=+25.756742531" watchObservedRunningTime="2026-07-23 21:26:32.429778236 +0000 UTC m=+25.757466955" Jul 23 21:26:33.244752 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:33.244522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:33.244933 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:33.244522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:33.244933 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:33.244855 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:33.244933 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:33.244917 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:33.413125 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:33.413088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" event={"ID":"87ff3137-7154-47f6-9d0e-493d92623c28","Type":"ContainerStarted","Data":"40761b5640316c2ee12ad1554e3e3c411e8a08ac2bd2dfc6a380fe3d3f528188"} Jul 23 21:26:33.429995 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:33.429942 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sc8qb" podStartSLOduration=3.309029414 podStartE2EDuration="26.429923783s" totalImagesPullingTime="23.120894369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:33.42982537 +0000 UTC m=+26.757514090" watchObservedRunningTime="2026-07-23 21:26:33.429923783 +0000 UTC m=+26.757612501" Jul 23 21:26:34.244340 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:34.244300 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:34.244522 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:34.244451 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:35.244178 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:35.244145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:35.244898 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:35.244276 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:35.244898 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:35.244337 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:35.244898 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:35.244441 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:35.418861 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:35.418785 2576 generic.go:356] "Generic (PLEG): container finished" podID="c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b" containerID="1fb201d0a1bc0935b2d45106f8ad8660d5b859dd98fc08cd2b7f4e53b00b932e" exitCode=0 Jul 23 21:26:35.419040 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:35.418878 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fbxr" event={"ID":"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b","Type":"ContainerDied","Data":"1fb201d0a1bc0935b2d45106f8ad8660d5b859dd98fc08cd2b7f4e53b00b932e"} Jul 23 21:26:35.422188 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:35.422170 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5j52_01dab5b8-48b4-4745-8526-c822fa9110a2/ovn-acl-logging/0.log" Jul 23 21:26:35.422616 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:35.422591 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" event={"ID":"01dab5b8-48b4-4745-8526-c822fa9110a2","Type":"ContainerStarted","Data":"dd0164dcc4bc536ff05a62f6dcc82292c66ee06fcbc3aa1b8214e470111168f1"} Jul 23 21:26:35.422899 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:35.422851 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:35.423040 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:35.422923 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:35.423100 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:35.423080 2576 scope.go:117] "RemoveContainer" containerID="d36ebc2022c6c770230bd7ad392985a8e3d4d72255b34cfbb9b5ac77d0748dff" Jul 23 21:26:35.438948 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:35.438928 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:35.439971 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:35.439952 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:36.243961 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:36.243925 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:36.244220 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:36.244047 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:36.429112 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:36.429089 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5j52_01dab5b8-48b4-4745-8526-c822fa9110a2/ovn-acl-logging/0.log" Jul 23 21:26:36.429522 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:36.429497 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" event={"ID":"01dab5b8-48b4-4745-8526-c822fa9110a2","Type":"ContainerStarted","Data":"81c8101f6315740339482135509fbc07fc24b5152d1a0ba6e832ae1d863dcc4a"} Jul 23 21:26:36.429606 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:36.429593 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 23 21:26:36.458278 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:36.458226 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" podStartSLOduration=8.456086834 podStartE2EDuration="29.458210759s" totalImagesPullingTime="21.002123925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:36.457786314 +0000 UTC m=+29.785475049" watchObservedRunningTime="2026-07-23 21:26:36.458210759 +0000 UTC m=+29.785899476" Jul 23 21:26:36.822624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:36.822537 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fphrs"] Jul 23 21:26:36.822818 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:36.822720 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:36.822886 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:36.822806 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:36.825221 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:36.825201 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2j5g9"] Jul 23 21:26:36.825313 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:36.825287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:36.825370 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:36.825355 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:36.836504 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:36.836477 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f27wm"] Jul 23 21:26:36.836608 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:36.836573 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:36.836685 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:36.836668 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:36.994401 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:36.994369 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:26:37.434385 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:37.434351 2576 generic.go:356] "Generic (PLEG): container finished" podID="c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b" containerID="76617b35c96874bbffc67ddadcd3a138a6ac9007d2410097f7fc4ea4f9394e3e" exitCode=0 Jul 23 21:26:37.434769 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:37.434439 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fbxr" event={"ID":"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b","Type":"ContainerDied","Data":"76617b35c96874bbffc67ddadcd3a138a6ac9007d2410097f7fc4ea4f9394e3e"} Jul 23 21:26:38.244289 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:38.244257 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:38.244494 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:38.244257 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:38.244494 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:38.244377 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:38.244494 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:38.244437 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:38.476754 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:38.476718 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:38.576394 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:38.576362 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:39.244109 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:39.243893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:39.244244 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:39.244135 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:39.442592 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:39.442557 2576 generic.go:356] "Generic (PLEG): container finished" podID="c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b" containerID="1dbb9d6f9a9bb1d6da77bbef384de433e198db8afaffe96756e361d862e97097" exitCode=0 Jul 23 21:26:39.442592 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:39.442594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fbxr" event={"ID":"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b","Type":"ContainerDied","Data":"1dbb9d6f9a9bb1d6da77bbef384de433e198db8afaffe96756e361d862e97097"} Jul 23 21:26:39.825093 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:39.825060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5w8z\" (UniqueName: \"kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z\") pod \"network-check-target-2j5g9\" (UID: \"711592be-4119-4571-a772-0e266a2f6571\") " pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:39.825458 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:39.825181 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 21:26:39.825458 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:39.825197 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 21:26:39.825458 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:39.825205 2576 projected.go:196] Error preparing data for projected volume kube-api-access-f5w8z for pod openshift-network-diagnostics/network-check-target-2j5g9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:39.825458 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:39.825255 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z podName:711592be-4119-4571-a772-0e266a2f6571 nodeName:}" failed. No retries permitted until 2026-07-23 21:27:11.825239671 +0000 UTC m=+65.152928367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f5w8z" (UniqueName: "kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z") pod "network-check-target-2j5g9" (UID: "711592be-4119-4571-a772-0e266a2f6571") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 21:26:39.926262 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:39.926232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:39.926450 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:39.926296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:39.926450 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:39.926395 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:39.926450 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:39.926403 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:39.926585 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:39.926465 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs podName:a7c3140f-42f4-4305-a9de-0f4ab5240702 nodeName:}" failed. No retries permitted until 2026-07-23 21:27:11.926447844 +0000 UTC m=+65.254136540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs") pod "network-metrics-daemon-f27wm" (UID: "a7c3140f-42f4-4305-a9de-0f4ab5240702") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 21:26:39.926585 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:39.926482 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret podName:b4c019a8-492c-4736-9e54-0289503edc1e nodeName:}" failed. No retries permitted until 2026-07-23 21:27:11.926474303 +0000 UTC m=+65.254163006 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret") pod "global-pull-secret-syncer-fphrs" (UID: "b4c019a8-492c-4736-9e54-0289503edc1e") : object "kube-system"/"original-pull-secret" not registered Jul 23 21:26:40.243779 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:40.243743 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:40.243945 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:40.243753 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:40.243945 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:40.243888 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:26:40.244026 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:40.243957 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fphrs" podUID="b4c019a8-492c-4736-9e54-0289503edc1e" Jul 23 21:26:41.243878 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.243846 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:41.244347 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:41.243976 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2j5g9" podUID="711592be-4119-4571-a772-0e266a2f6571" Jul 23 21:26:41.945645 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.945613 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-221.ec2.internal" event="NodeReady" Jul 23 21:26:41.945823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.945782 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 21:26:41.990624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.990537 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-665rd"] Jul 23 21:26:41.993302 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.993281 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-998p4"] Jul 23 21:26:41.993442 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.993419 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-665rd" Jul 23 21:26:41.995394 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.995364 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-998p4" Jul 23 21:26:41.996007 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.995979 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 21:26:41.996099 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.996018 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 21:26:41.996154 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.996110 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-47mvm\"" Jul 23 21:26:41.998010 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.997951 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dqp97\"" Jul 23 21:26:41.998010 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.997956 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 21:26:41.998176 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.998107 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 21:26:41.998176 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:41.998130 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 21:26:42.002194 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.002176 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-998p4"] Jul 23 21:26:42.005722 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.005699 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-665rd"] Jul 23 21:26:42.108500 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.108467 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:42.142210 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.142179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:42.142379 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.142222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-tmp-dir\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:42.142379 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.142294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp559\" (UniqueName: \"kubernetes.io/projected/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-kube-api-access-wp559\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:42.142506 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.142416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhszp\" (UniqueName: \"kubernetes.io/projected/cabbcb56-db1a-47bf-a01e-3e5e96c10812-kube-api-access-jhszp\") pod \"ingress-canary-998p4\" (UID: \"cabbcb56-db1a-47bf-a01e-3e5e96c10812\") " pod="openshift-ingress-canary/ingress-canary-998p4" Jul 23 21:26:42.142506 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.142467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cabbcb56-db1a-47bf-a01e-3e5e96c10812-cert\") pod \"ingress-canary-998p4\" (UID: \"cabbcb56-db1a-47bf-a01e-3e5e96c10812\") " pod="openshift-ingress-canary/ingress-canary-998p4" Jul 23 21:26:42.142506 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.142495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-config-volume\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:42.208689 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.208646 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:42.243018 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.242932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-tmp-dir\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:42.243018 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.242971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp559\" (UniqueName: \"kubernetes.io/projected/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-kube-api-access-wp559\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:42.243234 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.243062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhszp\" (UniqueName: \"kubernetes.io/projected/cabbcb56-db1a-47bf-a01e-3e5e96c10812-kube-api-access-jhszp\") pod \"ingress-canary-998p4\" (UID: \"cabbcb56-db1a-47bf-a01e-3e5e96c10812\") " pod="openshift-ingress-canary/ingress-canary-998p4" Jul 23 21:26:42.243234 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.243098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cabbcb56-db1a-47bf-a01e-3e5e96c10812-cert\") pod \"ingress-canary-998p4\" (UID: \"cabbcb56-db1a-47bf-a01e-3e5e96c10812\") " pod="openshift-ingress-canary/ingress-canary-998p4" Jul 23 21:26:42.243331 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.243225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-config-volume\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:42.243331 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.243278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:42.243331 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.243292 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-tmp-dir\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:42.243459 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:42.243379 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:42.243459 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:42.243438 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls podName:6e846bbf-3d90-4e9c-b16d-781db1c99dc8 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:42.743419219 +0000 UTC m=+36.071107927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls") pod "dns-default-665rd" (UID: "6e846bbf-3d90-4e9c-b16d-781db1c99dc8") : secret "dns-default-metrics-tls" not found Jul 23 21:26:42.243544 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.243505 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:26:42.243695 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.243665 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:26:42.243821 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.243666 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-config-volume\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:42.246593 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.246227 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 21:26:42.246593 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.246241 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2jpgm\"" Jul 23 21:26:42.247151 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.247095 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 21:26:42.248756 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.248736 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cabbcb56-db1a-47bf-a01e-3e5e96c10812-cert\") pod \"ingress-canary-998p4\" (UID: \"cabbcb56-db1a-47bf-a01e-3e5e96c10812\") " pod="openshift-ingress-canary/ingress-canary-998p4" Jul 23 21:26:42.254482 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.254458 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp559\" (UniqueName: \"kubernetes.io/projected/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-kube-api-access-wp559\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:42.254585 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.254531 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhszp\" (UniqueName: \"kubernetes.io/projected/cabbcb56-db1a-47bf-a01e-3e5e96c10812-kube-api-access-jhszp\") pod \"ingress-canary-998p4\" (UID: \"cabbcb56-db1a-47bf-a01e-3e5e96c10812\") " pod="openshift-ingress-canary/ingress-canary-998p4" Jul 23 21:26:42.311744 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.311713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-998p4" Jul 23 21:26:42.445014 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.444977 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:42.497016 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.496930 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:42.746918 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:42.746882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:42.747148 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:42.747024 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:42.747148 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:42.747107 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls podName:6e846bbf-3d90-4e9c-b16d-781db1c99dc8 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:43.747086415 +0000 UTC m=+37.074775129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls") pod "dns-default-665rd" (UID: "6e846bbf-3d90-4e9c-b16d-781db1c99dc8") : secret "dns-default-metrics-tls" not found Jul 23 21:26:43.245274 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:43.245240 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:43.247298 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:43.247273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:26:43.250339 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:43.250102 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 21:26:43.250339 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:43.250141 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 21:26:43.250339 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:43.250196 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kgmkj\"" Jul 23 21:26:43.307049 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:43.307002 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:43.485563 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:43.485402 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-998p4"] Jul 23 21:26:43.490185 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:26:43.490156 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcabbcb56_db1a_47bf_a01e_3e5e96c10812.slice/crio-22955eb26983bc7f4e28dde0dc7294f49dcdf94d38201e2c246930e6a05c0200 WatchSource:0}: Error finding container 22955eb26983bc7f4e28dde0dc7294f49dcdf94d38201e2c246930e6a05c0200: Status 404 returned error can't find the container with id 22955eb26983bc7f4e28dde0dc7294f49dcdf94d38201e2c246930e6a05c0200 Jul 23 21:26:43.753993 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:43.753893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:43.754145 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:43.754023 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:43.754145 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:43.754078 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls podName:6e846bbf-3d90-4e9c-b16d-781db1c99dc8 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:45.754064158 +0000 UTC m=+39.081752867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls") pod "dns-default-665rd" (UID: "6e846bbf-3d90-4e9c-b16d-781db1c99dc8") : secret "dns-default-metrics-tls" not found Jul 23 21:26:44.457794 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:44.457764 2576 generic.go:356] "Generic (PLEG): container finished" podID="c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b" containerID="212edf90fd9e9538e4f1bf5498ecc7340c74f1e787d5fab0cc53f71209de01d3" exitCode=0 Jul 23 21:26:44.458372 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:44.457851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fbxr" event={"ID":"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b","Type":"ContainerDied","Data":"212edf90fd9e9538e4f1bf5498ecc7340c74f1e787d5fab0cc53f71209de01d3"} Jul 23 21:26:44.463059 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:44.463030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-998p4" event={"ID":"cabbcb56-db1a-47bf-a01e-3e5e96c10812","Type":"ContainerStarted","Data":"22955eb26983bc7f4e28dde0dc7294f49dcdf94d38201e2c246930e6a05c0200"} Jul 23 21:26:45.469323 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:45.469288 2576 generic.go:356] "Generic (PLEG): container finished" podID="c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b" containerID="62ebb8ccced169e34961ce5937a4470734f3e4aee15b229d68c77edf60f27a57" exitCode=0 Jul 23 21:26:45.469323 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:45.469335 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fbxr" event={"ID":"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b","Type":"ContainerDied","Data":"62ebb8ccced169e34961ce5937a4470734f3e4aee15b229d68c77edf60f27a57"} Jul 23 21:26:45.769779 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:45.769742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:45.769914 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:45.769880 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:45.769995 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:45.769968 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls podName:6e846bbf-3d90-4e9c-b16d-781db1c99dc8 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:49.769948982 +0000 UTC m=+43.097637699 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls") pod "dns-default-665rd" (UID: "6e846bbf-3d90-4e9c-b16d-781db1c99dc8") : secret "dns-default-metrics-tls" not found Jul 23 21:26:46.476547 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:46.476355 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4fbxr" event={"ID":"c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b","Type":"ContainerStarted","Data":"e3652eb13b2af0bf5d145cd88ef074ff392740c7d894e3ce430be0b5ac6e4fc4"} Jul 23 21:26:46.478041 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:46.478015 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-998p4" event={"ID":"cabbcb56-db1a-47bf-a01e-3e5e96c10812","Type":"ContainerStarted","Data":"e728f3e96fd4431b196600ca8dc6f134f1ea6424375dff83fa4e10631877c198"} Jul 23 21:26:46.494378 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:46.494354 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:46.498866 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:46.498817 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4fbxr" podStartSLOduration=8.355531248 podStartE2EDuration="39.498801611s" totalImagesPullingTime="31.143270363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:46.49839129 +0000 UTC m=+39.826080024" watchObservedRunningTime="2026-07-23 21:26:46.498801611 +0000 UTC m=+39.826490328" Jul 23 21:26:46.513029 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:46.512988 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-998p4" podStartSLOduration=2.920778202 podStartE2EDuration="5.512975589s" totalImagesPullingTime="2.592197387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:26:46.512563733 +0000 UTC m=+39.840252461" watchObservedRunningTime="2026-07-23 21:26:46.512975589 +0000 UTC m=+39.840664306" Jul 23 21:26:46.595202 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:46.595167 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:46.696103 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:46.696022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:48.726056 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:48.726022 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:48.782731 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:48.782695 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:26:49.796563 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:49.796525 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:49.796950 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:49.796700 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:49.796950 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:49.796763 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls podName:6e846bbf-3d90-4e9c-b16d-781db1c99dc8 nodeName:}" failed. No retries permitted until 2026-07-23 21:26:57.796748987 +0000 UTC m=+51.124437722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls") pod "dns-default-665rd" (UID: "6e846bbf-3d90-4e9c-b16d-781db1c99dc8") : secret "dns-default-metrics-tls" not found Jul 23 21:26:57.848835 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:26:57.848794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:26:57.849302 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:57.848921 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:26:57.849302 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:26:57.849014 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls podName:6e846bbf-3d90-4e9c-b16d-781db1c99dc8 nodeName:}" failed. No retries permitted until 2026-07-23 21:27:13.849000371 +0000 UTC m=+67.176689066 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls") pod "dns-default-665rd" (UID: "6e846bbf-3d90-4e9c-b16d-781db1c99dc8") : secret "dns-default-metrics-tls" not found Jul 23 21:27:04.410080 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:04.410048 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:27:04.459183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:04.459151 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:27:08.457719 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:08.457693 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5j52" Jul 23 21:27:08.567013 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:08.566980 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:27:08.667929 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:08.667895 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:27:08.722820 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:08.722756 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:27:11.854165 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:11.854124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5w8z\" (UniqueName: \"kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z\") pod \"network-check-target-2j5g9\" (UID: \"711592be-4119-4571-a772-0e266a2f6571\") " pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:27:11.857156 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:11.857136 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 21:27:11.867465 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:11.867446 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 21:27:11.879568 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:11.879543 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5w8z\" (UniqueName: \"kubernetes.io/projected/711592be-4119-4571-a772-0e266a2f6571-kube-api-access-f5w8z\") pod \"network-check-target-2j5g9\" (UID: \"711592be-4119-4571-a772-0e266a2f6571\") " pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:27:11.955103 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:11.955054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:27:11.955272 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:11.955132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:27:11.957766 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:11.957748 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 21:27:11.957809 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:11.957748 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 21:27:11.966010 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:27:11.965993 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 21:27:11.966075 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:27:11.966066 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs podName:a7c3140f-42f4-4305-a9de-0f4ab5240702 nodeName:}" failed. No retries permitted until 2026-07-23 21:28:15.966048442 +0000 UTC m=+129.293737151 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs") pod "network-metrics-daemon-f27wm" (UID: "a7c3140f-42f4-4305-a9de-0f4ab5240702") : secret "metrics-daemon-secret" not found Jul 23 21:27:11.968170 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:11.968148 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4c019a8-492c-4736-9e54-0289503edc1e-original-pull-secret\") pod \"global-pull-secret-syncer-fphrs\" (UID: \"b4c019a8-492c-4736-9e54-0289503edc1e\") " pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:27:11.970134 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:11.970106 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fphrs" Jul 23 21:27:12.059586 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:12.059552 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kgmkj\"" Jul 23 21:27:12.067563 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:12.067537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:27:12.091551 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:12.091521 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fphrs"] Jul 23 21:27:12.094674 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:27:12.094649 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c019a8_492c_4736_9e54_0289503edc1e.slice/crio-5c2630e00d8683d66ba56c69351e0dc759d8d9cd93b42e7a6de993d43a0a942e WatchSource:0}: Error finding container 5c2630e00d8683d66ba56c69351e0dc759d8d9cd93b42e7a6de993d43a0a942e: Status 404 returned error can't find the container with id 5c2630e00d8683d66ba56c69351e0dc759d8d9cd93b42e7a6de993d43a0a942e Jul 23 21:27:12.188773 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:12.188743 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2j5g9"] Jul 23 21:27:12.191569 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:27:12.191540 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711592be_4119_4571_a772_0e266a2f6571.slice/crio-7705d0ecbd4d2a04ca169863f483c1b56fef249c87ecfc1b44f09cee402f3fdf WatchSource:0}: Error finding container 7705d0ecbd4d2a04ca169863f483c1b56fef249c87ecfc1b44f09cee402f3fdf: Status 404 returned error can't find the container with id 7705d0ecbd4d2a04ca169863f483c1b56fef249c87ecfc1b44f09cee402f3fdf Jul 23 21:27:12.540352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:12.540312 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2j5g9" event={"ID":"711592be-4119-4571-a772-0e266a2f6571","Type":"ContainerStarted","Data":"7705d0ecbd4d2a04ca169863f483c1b56fef249c87ecfc1b44f09cee402f3fdf"} Jul 23 21:27:12.541786 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:12.541754 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fphrs" event={"ID":"b4c019a8-492c-4736-9e54-0289503edc1e","Type":"ContainerStarted","Data":"5c2630e00d8683d66ba56c69351e0dc759d8d9cd93b42e7a6de993d43a0a942e"} Jul 23 21:27:13.866114 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:13.866065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:27:13.866557 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:27:13.866213 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:27:13.866557 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:27:13.866275 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls podName:6e846bbf-3d90-4e9c-b16d-781db1c99dc8 nodeName:}" failed. No retries permitted until 2026-07-23 21:27:45.86625811 +0000 UTC m=+99.193946826 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls") pod "dns-default-665rd" (UID: "6e846bbf-3d90-4e9c-b16d-781db1c99dc8") : secret "dns-default-metrics-tls" not found Jul 23 21:27:17.557722 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:17.557681 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2j5g9" event={"ID":"711592be-4119-4571-a772-0e266a2f6571","Type":"ContainerStarted","Data":"b1067ada4c2d31e60b5450132b2f26e225870b50a5c5f11d9985491c1a3b5e38"} Jul 23 21:27:17.558216 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:17.557797 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:27:17.559258 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:17.559234 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fphrs" event={"ID":"b4c019a8-492c-4736-9e54-0289503edc1e","Type":"ContainerStarted","Data":"e76298822ecee624cee2621ccad389d95451eae7ed8083ac1104036544384258"} Jul 23 21:27:17.573224 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:17.573185 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2j5g9" podStartSLOduration=65.869676308 podStartE2EDuration="1m10.573175515s" totalImagesPullingTime="4.703499207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:27:17.573005376 +0000 UTC m=+70.900694092" watchObservedRunningTime="2026-07-23 21:27:17.573175515 +0000 UTC m=+70.900864231" Jul 23 21:27:17.587438 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:17.587402 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fphrs" podStartSLOduration=65.774953305 podStartE2EDuration="1m10.587391118s" totalImagesPullingTime="4.812437813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:27:17.5868439 +0000 UTC m=+70.914532622" watchObservedRunningTime="2026-07-23 21:27:17.587391118 +0000 UTC m=+70.915079833" Jul 23 21:27:45.878864 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:45.878822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:27:45.879360 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:27:45.878947 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:27:45.879360 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:27:45.879000 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls podName:6e846bbf-3d90-4e9c-b16d-781db1c99dc8 nodeName:}" failed. No retries permitted until 2026-07-23 21:28:49.87898633 +0000 UTC m=+163.206675026 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls") pod "dns-default-665rd" (UID: "6e846bbf-3d90-4e9c-b16d-781db1c99dc8") : secret "dns-default-metrics-tls" not found Jul 23 21:27:48.563758 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:27:48.563721 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2j5g9" Jul 23 21:28:15.985181 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:28:15.985135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:28:15.985687 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:28:15.985272 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 21:28:15.985687 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:28:15.985348 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs podName:a7c3140f-42f4-4305-a9de-0f4ab5240702 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:17.985330058 +0000 UTC m=+251.313018769 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs") pod "network-metrics-daemon-f27wm" (UID: "a7c3140f-42f4-4305-a9de-0f4ab5240702") : secret "metrics-daemon-secret" not found Jul 23 21:28:45.005685 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:28:45.005618 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-665rd" podUID="6e846bbf-3d90-4e9c-b16d-781db1c99dc8" Jul 23 21:28:45.264524 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:28:45.264442 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f27wm" podUID="a7c3140f-42f4-4305-a9de-0f4ab5240702" Jul 23 21:28:45.765917 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:28:45.765886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-665rd" Jul 23 21:28:49.912957 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:28:49.912924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:28:49.913383 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:28:49.913046 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 21:28:49.913383 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:28:49.913107 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls podName:6e846bbf-3d90-4e9c-b16d-781db1c99dc8 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:51.913093005 +0000 UTC m=+285.240781703 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls") pod "dns-default-665rd" (UID: "6e846bbf-3d90-4e9c-b16d-781db1c99dc8") : secret "dns-default-metrics-tls" not found Jul 23 21:28:57.245425 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:28:57.245353 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:29:21.361585 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:21.361555 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:48.464216 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.464177 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j"] Jul 23 21:29:48.466197 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.466174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:29:48.469394 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.469375 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 23 21:29:48.469538 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.469520 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f664b44b-lrnks"] Jul 23 21:29:48.470133 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.470112 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8mx2t\"" Jul 23 21:29:48.470282 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.470266 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 23 21:29:48.471343 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.471327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.471895 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.471875 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:29:48.475383 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.475362 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 21:29:48.475586 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.475571 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8zssn\"" Jul 23 21:29:48.475855 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.475842 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 21:29:48.475855 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.475850 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 21:29:48.488413 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.488393 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j"] Jul 23 21:29:48.492165 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.492149 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 21:29:48.501893 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.501868 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-ca-trust-extracted\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.502011 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.501917 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-bound-sa-token\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.502011 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.501946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-certificates\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.502011 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.501964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-image-registry-private-configuration\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.502011 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.501991 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fsr2j\" (UID: \"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:29:48.502175 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.502031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvkgw\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-kube-api-access-mvkgw\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.502175 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.502062 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.502175 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.502100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx5q8\" (UniqueName: \"kubernetes.io/projected/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-kube-api-access-xx5q8\") pod \"cluster-samples-operator-79b7c55f87-fsr2j\" (UID: \"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:29:48.502175 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.502120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-trusted-ca\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.502175 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.502162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-installation-pull-secrets\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.502751 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.502730 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f664b44b-lrnks"] Jul 23 21:29:48.559126 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.559093 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z2rkq"] Jul 23 21:29:48.560932 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.560917 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z2rkq" Jul 23 21:29:48.563002 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.562983 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg"] Jul 23 21:29:48.563763 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.563748 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lz6mp\"" Jul 23 21:29:48.564006 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.563989 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 23 21:29:48.564073 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.564013 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:29:48.565121 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.565098 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" Jul 23 21:29:48.568000 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.567910 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 23 21:29:48.569378 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.568201 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vwkpc"] Jul 23 21:29:48.569378 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.568742 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 23 21:29:48.569378 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.568858 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2nhrm\"" Jul 23 21:29:48.569869 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.569838 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 23 21:29:48.569869 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.569843 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:29:48.571317 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.571299 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.573974 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.573957 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 21:29:48.574052 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.573957 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 23 21:29:48.574052 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.573993 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 21:29:48.574655 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.574610 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 23 21:29:48.575291 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.575273 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2h598\"" Jul 23 21:29:48.576175 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.576157 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z2rkq"] Jul 23 21:29:48.579559 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.579538 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 23 21:29:48.580542 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.580522 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg"] Jul 23 21:29:48.583298 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.583280 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vwkpc"] Jul 23 21:29:48.602616 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-bound-sa-token\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.602710 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38982c0c-81bb-4ea2-be6c-b9406f68c744-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9gqdg\" (UID: \"38982c0c-81bb-4ea2-be6c-b9406f68c744\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" Jul 23 21:29:48.602710 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-tmp\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.602710 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-certificates\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.602710 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38982c0c-81bb-4ea2-be6c-b9406f68c744-config\") pod \"service-ca-operator-5bcbc94c78-9gqdg\" (UID: \"38982c0c-81bb-4ea2-be6c-b9406f68c744\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" Jul 23 21:29:48.602867 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-snapshots\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.602867 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.602867 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602763 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-service-ca-bundle\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.602867 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-image-registry-private-configuration\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.602867 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h58jq\" (UniqueName: \"kubernetes.io/projected/5d647179-e8b3-484e-b732-9b007bfd84ab-kube-api-access-h58jq\") pod \"volume-data-source-validator-78cf4c6f6-z2rkq\" (UID: \"5d647179-e8b3-484e-b732-9b007bfd84ab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z2rkq" Jul 23 21:29:48.602867 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scx6r\" (UniqueName: \"kubernetes.io/projected/38982c0c-81bb-4ea2-be6c-b9406f68c744-kube-api-access-scx6r\") pod \"service-ca-operator-5bcbc94c78-9gqdg\" (UID: \"38982c0c-81bb-4ea2-be6c-b9406f68c744\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" Jul 23 21:29:48.602867 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fsr2j\" (UID: \"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:29:48.603178 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvkgw\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-kube-api-access-mvkgw\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.603178 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:48.602945 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 21:29:48.603178 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.602973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.603178 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:48.602998 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls podName:a83efc55-2d5d-430e-8b4f-24f0a1cb09d3 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:49.1029788 +0000 UTC m=+222.430667500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fsr2j" (UID: "a83efc55-2d5d-430e-8b4f-24f0a1cb09d3") : secret "samples-operator-tls" not found Jul 23 21:29:48.603178 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:48.603026 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:29:48.603178 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:48.603041 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f664b44b-lrnks: secret "image-registry-tls" not found Jul 23 21:29:48.603178 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.603025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tbzd\" (UniqueName: \"kubernetes.io/projected/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-kube-api-access-5tbzd\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.603178 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:48.603090 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls podName:95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf nodeName:}" failed. No retries permitted until 2026-07-23 21:29:49.103078114 +0000 UTC m=+222.430766812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls") pod "image-registry-f664b44b-lrnks" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf") : secret "image-registry-tls" not found Jul 23 21:29:48.603178 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.603122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx5q8\" (UniqueName: \"kubernetes.io/projected/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-kube-api-access-xx5q8\") pod \"cluster-samples-operator-79b7c55f87-fsr2j\" (UID: \"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:29:48.603178 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.603142 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-certificates\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.603178 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.603150 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-trusted-ca\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.603722 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.603189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-installation-pull-secrets\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.603722 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.603226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-serving-cert\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.603722 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.603252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-ca-trust-extracted\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.603722 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.603525 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-ca-trust-extracted\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.604145 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.604124 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-trusted-ca\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.605180 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.605162 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-image-registry-private-configuration\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.605364 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.605348 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-installation-pull-secrets\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.615003 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.614978 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-bound-sa-token\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.615165 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.615142 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx5q8\" (UniqueName: \"kubernetes.io/projected/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-kube-api-access-xx5q8\") pod \"cluster-samples-operator-79b7c55f87-fsr2j\" (UID: \"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:29:48.615227 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.615213 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvkgw\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-kube-api-access-mvkgw\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:48.697748 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.697717 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:48.703783 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.703762 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38982c0c-81bb-4ea2-be6c-b9406f68c744-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9gqdg\" (UID: \"38982c0c-81bb-4ea2-be6c-b9406f68c744\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" Jul 23 21:29:48.703857 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.703787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-tmp\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.703857 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.703804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38982c0c-81bb-4ea2-be6c-b9406f68c744-config\") pod \"service-ca-operator-5bcbc94c78-9gqdg\" (UID: \"38982c0c-81bb-4ea2-be6c-b9406f68c744\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" Jul 23 21:29:48.703857 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.703818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-snapshots\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.703857 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.703834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.703857 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.703850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-service-ca-bundle\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.704083 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.703895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h58jq\" (UniqueName: \"kubernetes.io/projected/5d647179-e8b3-484e-b732-9b007bfd84ab-kube-api-access-h58jq\") pod \"volume-data-source-validator-78cf4c6f6-z2rkq\" (UID: \"5d647179-e8b3-484e-b732-9b007bfd84ab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z2rkq" Jul 23 21:29:48.704083 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.703930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scx6r\" (UniqueName: \"kubernetes.io/projected/38982c0c-81bb-4ea2-be6c-b9406f68c744-kube-api-access-scx6r\") pod \"service-ca-operator-5bcbc94c78-9gqdg\" (UID: \"38982c0c-81bb-4ea2-be6c-b9406f68c744\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" Jul 23 21:29:48.704083 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.704004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tbzd\" (UniqueName: \"kubernetes.io/projected/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-kube-api-access-5tbzd\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.704083 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.704067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-serving-cert\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.704277 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.704137 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-tmp\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.704478 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.704454 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-service-ca-bundle\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.704617 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.704600 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38982c0c-81bb-4ea2-be6c-b9406f68c744-config\") pod \"service-ca-operator-5bcbc94c78-9gqdg\" (UID: \"38982c0c-81bb-4ea2-be6c-b9406f68c744\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" Jul 23 21:29:48.704762 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.704743 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-snapshots\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.705079 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.705064 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.706180 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.706158 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38982c0c-81bb-4ea2-be6c-b9406f68c744-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9gqdg\" (UID: \"38982c0c-81bb-4ea2-be6c-b9406f68c744\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" Jul 23 21:29:48.706576 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.706556 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-serving-cert\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.711914 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.711890 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scx6r\" (UniqueName: \"kubernetes.io/projected/38982c0c-81bb-4ea2-be6c-b9406f68c744-kube-api-access-scx6r\") pod \"service-ca-operator-5bcbc94c78-9gqdg\" (UID: \"38982c0c-81bb-4ea2-be6c-b9406f68c744\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" Jul 23 21:29:48.712268 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.712246 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tbzd\" (UniqueName: \"kubernetes.io/projected/a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f-kube-api-access-5tbzd\") pod \"insights-operator-555d9d7885-vwkpc\" (UID: \"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f\") " pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:48.712312 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.712249 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h58jq\" (UniqueName: \"kubernetes.io/projected/5d647179-e8b3-484e-b732-9b007bfd84ab-kube-api-access-h58jq\") pod \"volume-data-source-validator-78cf4c6f6-z2rkq\" (UID: \"5d647179-e8b3-484e-b732-9b007bfd84ab\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z2rkq" Jul 23 21:29:48.875773 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.875729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z2rkq" Jul 23 21:29:48.883796 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.883779 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" Jul 23 21:29:48.888861 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:48.888844 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-vwkpc" Jul 23 21:29:49.015481 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:49.015456 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z2rkq"] Jul 23 21:29:49.017921 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:29:49.017892 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d647179_e8b3_484e_b732_9b007bfd84ab.slice/crio-7d562b4b1ef61f93999cdadf3f92041d7e33df7d51f3bbfc329fe94cf6770778 WatchSource:0}: Error finding container 7d562b4b1ef61f93999cdadf3f92041d7e33df7d51f3bbfc329fe94cf6770778: Status 404 returned error can't find the container with id 7d562b4b1ef61f93999cdadf3f92041d7e33df7d51f3bbfc329fe94cf6770778 Jul 23 21:29:49.106858 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:49.106829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fsr2j\" (UID: \"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:29:49.106997 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:49.106865 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:49.106997 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:49.106974 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 21:29:49.107067 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:49.107031 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls podName:a83efc55-2d5d-430e-8b4f-24f0a1cb09d3 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:50.107016938 +0000 UTC m=+223.434705633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fsr2j" (UID: "a83efc55-2d5d-430e-8b4f-24f0a1cb09d3") : secret "samples-operator-tls" not found Jul 23 21:29:49.107067 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:49.106975 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:29:49.107137 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:49.107077 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f664b44b-lrnks: secret "image-registry-tls" not found Jul 23 21:29:49.107137 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:49.107129 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls podName:95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf nodeName:}" failed. No retries permitted until 2026-07-23 21:29:50.107118248 +0000 UTC m=+223.434806970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls") pod "image-registry-f664b44b-lrnks" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf") : secret "image-registry-tls" not found Jul 23 21:29:49.237046 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:49.237021 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg"] Jul 23 21:29:49.239550 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:29:49.239520 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38982c0c_81bb_4ea2_be6c_b9406f68c744.slice/crio-32403cbe155cf878f169c45d23909516713743c5f1c16215dc956c877069308c WatchSource:0}: Error finding container 32403cbe155cf878f169c45d23909516713743c5f1c16215dc956c877069308c: Status 404 returned error can't find the container with id 32403cbe155cf878f169c45d23909516713743c5f1c16215dc956c877069308c Jul 23 21:29:49.240647 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:49.240602 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vwkpc"] Jul 23 21:29:49.243095 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:29:49.243048 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ef6c79_75c7_4ce2_b753_bf2c3c0a819f.slice/crio-cf57d29a810a86e5e04d6dc78498fe1eb5ce0ff041701c1873ba7df21884108c WatchSource:0}: Error finding container cf57d29a810a86e5e04d6dc78498fe1eb5ce0ff041701c1873ba7df21884108c: Status 404 returned error can't find the container with id cf57d29a810a86e5e04d6dc78498fe1eb5ce0ff041701c1873ba7df21884108c Jul 23 21:29:49.697772 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:49.697734 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:49.916293 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:49.916259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vwkpc" event={"ID":"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f","Type":"ContainerStarted","Data":"cf57d29a810a86e5e04d6dc78498fe1eb5ce0ff041701c1873ba7df21884108c"} Jul 23 21:29:49.917358 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:49.917337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" event={"ID":"38982c0c-81bb-4ea2-be6c-b9406f68c744","Type":"ContainerStarted","Data":"32403cbe155cf878f169c45d23909516713743c5f1c16215dc956c877069308c"} Jul 23 21:29:49.918292 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:49.918271 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z2rkq" event={"ID":"5d647179-e8b3-484e-b732-9b007bfd84ab","Type":"ContainerStarted","Data":"7d562b4b1ef61f93999cdadf3f92041d7e33df7d51f3bbfc329fe94cf6770778"} Jul 23 21:29:50.115521 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:50.115482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fsr2j\" (UID: \"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:29:50.115729 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:50.115540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:50.115729 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:50.115688 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 21:29:50.115817 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:50.115730 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:29:50.115817 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:50.115744 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f664b44b-lrnks: secret "image-registry-tls" not found Jul 23 21:29:50.115817 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:50.115772 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls podName:a83efc55-2d5d-430e-8b4f-24f0a1cb09d3 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:52.115751868 +0000 UTC m=+225.443440564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fsr2j" (UID: "a83efc55-2d5d-430e-8b4f-24f0a1cb09d3") : secret "samples-operator-tls" not found Jul 23 21:29:50.115817 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:50.115792 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls podName:95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf nodeName:}" failed. No retries permitted until 2026-07-23 21:29:52.115780896 +0000 UTC m=+225.443469592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls") pod "image-registry-f664b44b-lrnks" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf") : secret "image-registry-tls" not found Jul 23 21:29:50.923051 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:50.923005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z2rkq" event={"ID":"5d647179-e8b3-484e-b732-9b007bfd84ab","Type":"ContainerStarted","Data":"73f6103758874929a57010461c73ae21747e4951b7c080929424ff3b4c62b5c0"} Jul 23 21:29:50.938839 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:50.938669 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z2rkq" podStartSLOduration=1.515537887 podStartE2EDuration="2.938653732s" totalImagesPullingTime="1.423115845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:29:50.938331735 +0000 UTC m=+224.266020454" watchObservedRunningTime="2026-07-23 21:29:50.938653732 +0000 UTC m=+224.266342450" Jul 23 21:29:51.017423 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:51.017386 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:51.118381 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:51.118345 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:51.928434 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:51.928394 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" event={"ID":"38982c0c-81bb-4ea2-be6c-b9406f68c744","Type":"ContainerStarted","Data":"69a986a2181de880224d5ebec470e6ea54e8e08d4a1b81cb4c9602d51105866a"} Jul 23 21:29:51.944344 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:51.944288 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" podStartSLOduration=1.8435262140000002 podStartE2EDuration="3.944268286s" totalImagesPullingTime="2.100742072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:29:51.943319221 +0000 UTC m=+225.271007939" watchObservedRunningTime="2026-07-23 21:29:51.944268286 +0000 UTC m=+225.271957002" Jul 23 21:29:52.132881 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:52.132831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fsr2j\" (UID: \"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:29:52.133040 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:52.132892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:52.133040 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:52.132988 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 21:29:52.133040 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:52.133012 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:29:52.133040 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:52.133025 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f664b44b-lrnks: secret "image-registry-tls" not found Jul 23 21:29:52.133181 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:52.133057 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls podName:a83efc55-2d5d-430e-8b4f-24f0a1cb09d3 nodeName:}" failed. No retries permitted until 2026-07-23 21:29:56.133040976 +0000 UTC m=+229.460729688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fsr2j" (UID: "a83efc55-2d5d-430e-8b4f-24f0a1cb09d3") : secret "samples-operator-tls" not found Jul 23 21:29:52.133181 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:52.133074 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls podName:95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf nodeName:}" failed. No retries permitted until 2026-07-23 21:29:56.133065504 +0000 UTC m=+229.460754200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls") pod "image-registry-f664b44b-lrnks" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf") : secret "image-registry-tls" not found Jul 23 21:29:52.497538 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:52.497511 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:52.556853 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:52.556822 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:52.813612 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:52.813582 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:52.909857 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:52.909812 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:52.932315 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:52.932282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vwkpc" event={"ID":"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f","Type":"ContainerStarted","Data":"6fcf9bcb766a89aaaf841273c4fa8868c90df9e8b38998e4a185cfcacfcd00f1"} Jul 23 21:29:52.947574 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:52.947519 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-vwkpc" podStartSLOduration=2.179018963 podStartE2EDuration="4.947503985s" totalImagesPullingTime="2.768485022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:29:52.946902826 +0000 UTC m=+226.274591543" watchObservedRunningTime="2026-07-23 21:29:52.947503985 +0000 UTC m=+226.275192680" Jul 23 21:29:53.010156 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.010125 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:53.145399 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.145333 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zbh6x"] Jul 23 21:29:53.148470 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.148449 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.150879 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.150859 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 21:29:53.150984 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.150889 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l265n\"" Jul 23 21:29:53.150984 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.150892 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 21:29:53.161049 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.161023 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zbh6x"] Jul 23 21:29:53.181110 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.181078 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:53.236325 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.236300 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:53.241360 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.241339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6390148-2edc-4a19-b84c-6c06a0d79c8e-crio-socket\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.241496 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.241386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.241496 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.241482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6390148-2edc-4a19-b84c-6c06a0d79c8e-data-volume\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.241602 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.241521 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.241602 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.241566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmqnb\" (UniqueName: \"kubernetes.io/projected/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-api-access-wmqnb\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.342397 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.342368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6390148-2edc-4a19-b84c-6c06a0d79c8e-data-volume\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.342578 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.342403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.342578 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.342430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmqnb\" (UniqueName: \"kubernetes.io/projected/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-api-access-wmqnb\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.342578 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.342472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6390148-2edc-4a19-b84c-6c06a0d79c8e-crio-socket\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.342578 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.342526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.342578 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:53.342557 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:29:53.342853 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:53.342584 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:29:53.342853 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:53.342618 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls podName:b6390148-2edc-4a19-b84c-6c06a0d79c8e nodeName:}" failed. No retries permitted until 2026-07-23 21:29:53.842600358 +0000 UTC m=+227.170289072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zbh6x" (UID: "b6390148-2edc-4a19-b84c-6c06a0d79c8e") : secret "insights-runtime-extractor-tls" not found Jul 23 21:29:53.342853 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.342610 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6390148-2edc-4a19-b84c-6c06a0d79c8e-crio-socket\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.342853 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:53.342697 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm podName:b6390148-2edc-4a19-b84c-6c06a0d79c8e nodeName:}" failed. No retries permitted until 2026-07-23 21:29:53.842667713 +0000 UTC m=+227.170356418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zbh6x" (UID: "b6390148-2edc-4a19-b84c-6c06a0d79c8e") : configmap "kube-rbac-proxy" not found Jul 23 21:29:53.342853 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.342765 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6390148-2edc-4a19-b84c-6c06a0d79c8e-data-volume\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.351090 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.351065 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmqnb\" (UniqueName: \"kubernetes.io/projected/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-api-access-wmqnb\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.788391 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.788354 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-4q5xx"] Jul 23 21:29:53.790603 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.790589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-4q5xx" Jul 23 21:29:53.792976 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.792953 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 23 21:29:53.792976 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.792956 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 23 21:29:53.793252 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.793236 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cm6fr\"" Jul 23 21:29:53.798661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.798622 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-4q5xx"] Jul 23 21:29:53.847585 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.847543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.847775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.847665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:53.847775 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:53.847690 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:29:53.847775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.847734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrbq\" (UniqueName: \"kubernetes.io/projected/234a9ac5-7e43-4b49-b018-f7e8fa03a161-kube-api-access-8zrbq\") pod \"migrator-7cc9c7ffd7-4q5xx\" (UID: \"234a9ac5-7e43-4b49-b018-f7e8fa03a161\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-4q5xx" Jul 23 21:29:53.847775 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:53.847756 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm podName:b6390148-2edc-4a19-b84c-6c06a0d79c8e nodeName:}" failed. No retries permitted until 2026-07-23 21:29:54.847733316 +0000 UTC m=+228.175422026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zbh6x" (UID: "b6390148-2edc-4a19-b84c-6c06a0d79c8e") : configmap "kube-rbac-proxy" not found Jul 23 21:29:53.847919 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:53.847810 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:29:53.847919 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:53.847873 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls podName:b6390148-2edc-4a19-b84c-6c06a0d79c8e nodeName:}" failed. No retries permitted until 2026-07-23 21:29:54.847858858 +0000 UTC m=+228.175547559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zbh6x" (UID: "b6390148-2edc-4a19-b84c-6c06a0d79c8e") : secret "insights-runtime-extractor-tls" not found Jul 23 21:29:53.855873 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.855840 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:53.948959 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.948931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrbq\" (UniqueName: \"kubernetes.io/projected/234a9ac5-7e43-4b49-b018-f7e8fa03a161-kube-api-access-8zrbq\") pod \"migrator-7cc9c7ffd7-4q5xx\" (UID: \"234a9ac5-7e43-4b49-b018-f7e8fa03a161\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-4q5xx" Jul 23 21:29:53.956035 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.956006 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:53.956782 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:53.956754 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrbq\" (UniqueName: \"kubernetes.io/projected/234a9ac5-7e43-4b49-b018-f7e8fa03a161-kube-api-access-8zrbq\") pod \"migrator-7cc9c7ffd7-4q5xx\" (UID: \"234a9ac5-7e43-4b49-b018-f7e8fa03a161\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-4q5xx" Jul 23 21:29:54.100371 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:54.100293 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-4q5xx" Jul 23 21:29:54.222120 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:54.222091 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-4q5xx"] Jul 23 21:29:54.224892 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:29:54.224864 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234a9ac5_7e43_4b49_b018_f7e8fa03a161.slice/crio-d000455e832116eafe4ea9b85dd584cd2c1bc2ea4b37b25c241c7c2e0d49c662 WatchSource:0}: Error finding container d000455e832116eafe4ea9b85dd584cd2c1bc2ea4b37b25c241c7c2e0d49c662: Status 404 returned error can't find the container with id d000455e832116eafe4ea9b85dd584cd2c1bc2ea4b37b25c241c7c2e0d49c662 Jul 23 21:29:54.854494 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:54.854457 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:54.856559 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:54.856523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:54.856706 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:54.856619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:54.856706 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:54.856675 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:29:54.856822 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:54.856732 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:29:54.856822 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:54.856754 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm podName:b6390148-2edc-4a19-b84c-6c06a0d79c8e nodeName:}" failed. No retries permitted until 2026-07-23 21:29:56.856733883 +0000 UTC m=+230.184422582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zbh6x" (UID: "b6390148-2edc-4a19-b84c-6c06a0d79c8e") : configmap "kube-rbac-proxy" not found Jul 23 21:29:54.856822 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:54.856780 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls podName:b6390148-2edc-4a19-b84c-6c06a0d79c8e nodeName:}" failed. No retries permitted until 2026-07-23 21:29:56.856767602 +0000 UTC m=+230.184456331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zbh6x" (UID: "b6390148-2edc-4a19-b84c-6c06a0d79c8e") : secret "insights-runtime-extractor-tls" not found Jul 23 21:29:54.940260 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:54.940223 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-4q5xx" event={"ID":"234a9ac5-7e43-4b49-b018-f7e8fa03a161","Type":"ContainerStarted","Data":"d000455e832116eafe4ea9b85dd584cd2c1bc2ea4b37b25c241c7c2e0d49c662"} Jul 23 21:29:55.134105 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:55.134019 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qzzbv_9dd834fa-cfaf-4978-8827-e8885dde51fc/dns-node-resolver/0.log" Jul 23 21:29:55.720540 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:55.720457 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:55.945752 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:55.945718 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-4q5xx" event={"ID":"234a9ac5-7e43-4b49-b018-f7e8fa03a161","Type":"ContainerStarted","Data":"77e1427300ccb25328664fa0246f357812125865b1c32ca9130babfafd654cb5"} Jul 23 21:29:55.945910 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:55.945771 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-4q5xx" event={"ID":"234a9ac5-7e43-4b49-b018-f7e8fa03a161","Type":"ContainerStarted","Data":"8715f1381b0d507e8e3406137978a657bc9bef7fb04e8b521be08289f9aeef3d"} Jul 23 21:29:55.964767 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:55.964719 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-4q5xx" podStartSLOduration=1.912218258 podStartE2EDuration="2.964706107s" totalImagesPullingTime="1.052487849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:29:55.962960432 +0000 UTC m=+229.290649172" watchObservedRunningTime="2026-07-23 21:29:55.964706107 +0000 UTC m=+229.292394823" Jul 23 21:29:56.135006 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:56.134978 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8s2x6_f16ca22b-c9f7-4d03-bd6c-b8e38a72777e/node-ca/0.log" Jul 23 21:29:56.167529 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:56.167490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:29:56.167675 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:56.167542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fsr2j\" (UID: \"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:29:56.167675 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:56.167654 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 23 21:29:56.167675 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:56.167659 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 21:29:56.167675 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:56.167673 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f664b44b-lrnks: secret "image-registry-tls" not found Jul 23 21:29:56.167817 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:56.167709 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls podName:a83efc55-2d5d-430e-8b4f-24f0a1cb09d3 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:04.167696345 +0000 UTC m=+237.495385043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-fsr2j" (UID: "a83efc55-2d5d-430e-8b4f-24f0a1cb09d3") : secret "samples-operator-tls" not found Jul 23 21:29:56.167817 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:56.167727 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls podName:95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf nodeName:}" failed. No retries permitted until 2026-07-23 21:30:04.167716571 +0000 UTC m=+237.495405269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls") pod "image-registry-f664b44b-lrnks" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf") : secret "image-registry-tls" not found Jul 23 21:29:56.734473 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:56.734444 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-998p4_cabbcb56-db1a-47bf-a01e-3e5e96c10812/serve-healthcheck-canary/0.log" Jul 23 21:29:56.872214 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:56.872170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:56.872378 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:56.872239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:29:56.872378 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:56.872294 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:29:56.872378 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:56.872321 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:29:56.872378 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:56.872352 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm podName:b6390148-2edc-4a19-b84c-6c06a0d79c8e nodeName:}" failed. No retries permitted until 2026-07-23 21:30:00.872338736 +0000 UTC m=+234.200027431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zbh6x" (UID: "b6390148-2edc-4a19-b84c-6c06a0d79c8e") : configmap "kube-rbac-proxy" not found Jul 23 21:29:56.872378 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:29:56.872370 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls podName:b6390148-2edc-4a19-b84c-6c06a0d79c8e nodeName:}" failed. No retries permitted until 2026-07-23 21:30:00.872359609 +0000 UTC m=+234.200048304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zbh6x" (UID: "b6390148-2edc-4a19-b84c-6c06a0d79c8e") : secret "insights-runtime-extractor-tls" not found Jul 23 21:29:58.611914 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:58.611883 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:58.665511 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:58.665477 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:58.845866 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:58.845833 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:58.945253 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:58.945152 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:59.087340 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:59.087290 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:59.188548 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:59.188518 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:59.377208 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:59.377179 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:59.478458 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:59.478426 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:29:59.907969 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:29:59.907944 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:00.329734 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:00.329704 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:00.906054 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:00.906014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:30:00.906205 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:00.906124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:30:00.906205 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:30:00.906163 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 21:30:00.906290 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:30:00.906205 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 21:30:00.906290 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:30:00.906235 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls podName:b6390148-2edc-4a19-b84c-6c06a0d79c8e nodeName:}" failed. No retries permitted until 2026-07-23 21:30:08.906217916 +0000 UTC m=+242.233906612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zbh6x" (UID: "b6390148-2edc-4a19-b84c-6c06a0d79c8e") : secret "insights-runtime-extractor-tls" not found Jul 23 21:30:00.906290 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:30:00.906253 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm podName:b6390148-2edc-4a19-b84c-6c06a0d79c8e nodeName:}" failed. No retries permitted until 2026-07-23 21:30:08.906244838 +0000 UTC m=+242.233933533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zbh6x" (UID: "b6390148-2edc-4a19-b84c-6c06a0d79c8e") : configmap "kube-rbac-proxy" not found Jul 23 21:30:01.138698 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:01.138664 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:01.315567 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:01.315536 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:01.417101 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:01.417068 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:01.808543 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:01.808477 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:01.925535 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:01.925507 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:02.113898 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:02.113809 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:02.426255 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:02.426168 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:02.524923 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:02.524894 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:03.312007 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:03.311975 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:03.510596 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:03.510551 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:03.707506 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:03.707415 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:03.990096 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:03.990011 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:04.109834 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.109805 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:04.234928 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.234900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:30:04.235081 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.234945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fsr2j\" (UID: \"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:30:04.237402 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.237371 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a83efc55-2d5d-430e-8b4f-24f0a1cb09d3-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-fsr2j\" (UID: \"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:30:04.237522 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.237375 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls\") pod \"image-registry-f664b44b-lrnks\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:30:04.375320 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.375285 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" Jul 23 21:30:04.380624 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.380602 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:30:04.510203 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.510166 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j"] Jul 23 21:30:04.530393 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.530373 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f664b44b-lrnks"] Jul 23 21:30:04.533615 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:30:04.533590 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ed6ed5_ff61_42bd_b4f5_e894b8e10ebf.slice/crio-f49dbddbbc47b604242684e71ef86f96495bd2a70f801030cde49b56fa9677ff WatchSource:0}: Error finding container f49dbddbbc47b604242684e71ef86f96495bd2a70f801030cde49b56fa9677ff: Status 404 returned error can't find the container with id f49dbddbbc47b604242684e71ef86f96495bd2a70f801030cde49b56fa9677ff Jul 23 21:30:04.712984 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.712905 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:04.976570 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.976492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f664b44b-lrnks" event={"ID":"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf","Type":"ContainerStarted","Data":"7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992"} Jul 23 21:30:04.976570 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.976550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f664b44b-lrnks" event={"ID":"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf","Type":"ContainerStarted","Data":"f49dbddbbc47b604242684e71ef86f96495bd2a70f801030cde49b56fa9677ff"} Jul 23 21:30:04.976813 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.976596 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:30:04.977615 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.977596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" event={"ID":"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3","Type":"ContainerStarted","Data":"c835b6c61c9db10ea866a7e7a8d3f9a9f1e50ff279dc211d4fd02c2156a0582d"} Jul 23 21:30:05.000460 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:04.998424 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f664b44b-lrnks" podStartSLOduration=16.99840392 podStartE2EDuration="16.99840392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:29:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:04.996842982 +0000 UTC m=+238.324531709" watchObservedRunningTime="2026-07-23 21:30:04.99840392 +0000 UTC m=+238.326092638" Jul 23 21:30:05.314997 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:05.314910 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:05.518111 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:05.518074 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:05.709518 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:05.709397 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:05.909288 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:05.909250 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:06.058755 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:06.058723 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:06.159367 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:06.159338 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:06.986012 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:06.985970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" event={"ID":"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3","Type":"ContainerStarted","Data":"c00fbdf794f91ff8ddaad5cebb12b4af933495a45ec98ffdcc490361865a78ef"} Jul 23 21:30:06.986373 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:06.986035 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" event={"ID":"a83efc55-2d5d-430e-8b4f-24f0a1cb09d3","Type":"ContainerStarted","Data":"5ca0712f60e166dc499c8bcb1def6b739ad95d6977db5b8093de550ad676f72d"} Jul 23 21:30:07.001838 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:07.001795 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-fsr2j" podStartSLOduration=17.371288255 podStartE2EDuration="19.001780698s" totalImagesPullingTime="1.630492443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:07.000662314 +0000 UTC m=+240.328351032" watchObservedRunningTime="2026-07-23 21:30:07.001780698 +0000 UTC m=+240.329469414" Jul 23 21:30:07.332241 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:07.332206 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:07.509330 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:07.509300 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:07.711417 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:07.711336 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:07.909459 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:07.909423 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:08.111105 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:08.111074 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:08.913946 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:08.913904 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:08.976270 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:08.976239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:30:08.976374 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:08.976294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:30:08.976795 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:08.976774 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6390148-2edc-4a19-b84c-6c06a0d79c8e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:30:08.978606 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:08.978585 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6390148-2edc-4a19-b84c-6c06a0d79c8e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zbh6x\" (UID: \"b6390148-2edc-4a19-b84c-6c06a0d79c8e\") " pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:30:09.059859 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:09.059828 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l265n\"" Jul 23 21:30:09.068771 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:09.068752 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zbh6x" Jul 23 21:30:09.112991 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:09.112966 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:09.198144 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:09.198052 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zbh6x"] Jul 23 21:30:09.200903 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:30:09.200877 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6390148_2edc_4a19_b84c_6c06a0d79c8e.slice/crio-66d2da531dee8e74984694422836fb00cb3c52e4dba92867cc5798e0b9943dfe WatchSource:0}: Error finding container 66d2da531dee8e74984694422836fb00cb3c52e4dba92867cc5798e0b9943dfe: Status 404 returned error can't find the container with id 66d2da531dee8e74984694422836fb00cb3c52e4dba92867cc5798e0b9943dfe Jul 23 21:30:09.313449 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:09.313419 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:09.996919 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:09.996879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zbh6x" event={"ID":"b6390148-2edc-4a19-b84c-6c06a0d79c8e","Type":"ContainerStarted","Data":"66d2da531dee8e74984694422836fb00cb3c52e4dba92867cc5798e0b9943dfe"} Jul 23 21:30:13.067948 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:13.067913 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:13.124677 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:13.124618 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:14.012516 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:14.012485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zbh6x" event={"ID":"b6390148-2edc-4a19-b84c-6c06a0d79c8e","Type":"ContainerStarted","Data":"24418ba3275f22f6b46c11f2c958a3cfc370917b68c66182cead091c60c5d2b6"} Jul 23 21:30:15.024002 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:15.023963 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:15.124826 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:15.124786 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:15.321053 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:15.321025 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:15.503502 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:15.503461 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:15.696568 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:15.696472 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:15.749572 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:15.749513 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:16.097384 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.097348 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:16.670442 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.670411 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f664b44b-lrnks"] Jul 23 21:30:16.713219 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.713181 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-677bd4fbc7-xgdst"] Jul 23 21:30:16.722250 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.722193 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.743989 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.743953 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:16.763703 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.763674 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-677bd4fbc7-xgdst"] Jul 23 21:30:16.835311 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.835260 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:16.838225 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.838201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-image-registry-private-configuration\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.838352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.838232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-installation-pull-secrets\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.838352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.838265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-registry-certificates\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.838352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.838319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-ca-trust-extracted\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.838518 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.838359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z8c9\" (UniqueName: \"kubernetes.io/projected/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-kube-api-access-5z8c9\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.838518 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.838383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-registry-tls\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.838518 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.838407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-bound-sa-token\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.838518 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.838460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-trusted-ca\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.937110 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.937021 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:16.939175 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.939146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-trusted-ca\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.939274 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.939196 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-image-registry-private-configuration\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.939274 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.939228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-installation-pull-secrets\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.939274 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.939260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-registry-certificates\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.939425 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.939302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-ca-trust-extracted\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.939425 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.939352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z8c9\" (UniqueName: \"kubernetes.io/projected/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-kube-api-access-5z8c9\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.939425 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.939379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-registry-tls\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.939425 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.939404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-bound-sa-token\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.940307 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.940072 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-ca-trust-extracted\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.940307 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.940157 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-trusted-ca\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.940521 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.940442 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-registry-certificates\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.942266 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.942244 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-image-registry-private-configuration\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.942369 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.942266 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-registry-tls\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.942440 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.942397 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-installation-pull-secrets\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.947817 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.947797 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z8c9\" (UniqueName: \"kubernetes.io/projected/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-kube-api-access-5z8c9\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:16.948943 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:16.948906 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618-bound-sa-token\") pod \"image-registry-677bd4fbc7-xgdst\" (UID: \"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618\") " pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:17.032615 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:17.032583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:17.110040 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:17.110010 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:17.243052 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:17.243021 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:17.286121 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:17.286094 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-677bd4fbc7-xgdst"] Jul 23 21:30:17.288154 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:30:17.288132 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbcf5f0e_ad40_42ad_83e0_f8a0c8e25618.slice/crio-56e060e983fcb8cf7bdfcd7bb804e9b3b28650df96acb60ef7e906f105fe61d9 WatchSource:0}: Error finding container 56e060e983fcb8cf7bdfcd7bb804e9b3b28650df96acb60ef7e906f105fe61d9: Status 404 returned error can't find the container with id 56e060e983fcb8cf7bdfcd7bb804e9b3b28650df96acb60ef7e906f105fe61d9 Jul 23 21:30:17.537851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:17.537821 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:17.638560 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:17.638531 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:18.029847 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:18.029761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zbh6x" event={"ID":"b6390148-2edc-4a19-b84c-6c06a0d79c8e","Type":"ContainerStarted","Data":"bce4856a073500b48f54e721190d1f7030c1f74711de00151df3ee61169bb890"} Jul 23 21:30:18.031401 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:18.031379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" event={"ID":"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618","Type":"ContainerStarted","Data":"7f9e5b2cdcdbeefeb76bf0ee122406892ae4fa3507c7f3f28ca53fd7c12798c1"} Jul 23 21:30:18.031521 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:18.031416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" event={"ID":"fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618","Type":"ContainerStarted","Data":"56e060e983fcb8cf7bdfcd7bb804e9b3b28650df96acb60ef7e906f105fe61d9"} Jul 23 21:30:18.031575 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:18.031532 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:18.043735 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:18.043711 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:18.048779 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:18.048758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:30:18.051520 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:18.051498 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7c3140f-42f4-4305-a9de-0f4ab5240702-metrics-certs\") pod \"network-metrics-daemon-f27wm\" (UID: \"a7c3140f-42f4-4305-a9de-0f4ab5240702\") " pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:30:18.052674 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:18.052605 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" podStartSLOduration=2.052588964 podStartE2EDuration="2.052588964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:18.051054817 +0000 UTC m=+251.378743569" watchObservedRunningTime="2026-07-23 21:30:18.052588964 +0000 UTC m=+251.380277682" Jul 23 21:30:18.249479 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:18.249443 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2jpgm\"" Jul 23 21:30:18.257667 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:18.257602 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f27wm" Jul 23 21:30:18.405030 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:18.404984 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f27wm"] Jul 23 21:30:18.408001 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:30:18.407969 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c3140f_42f4_4305_a9de_0f4ab5240702.slice/crio-e71f252c75ecb7f35223727a684c93055c8eccee2645fb41c94573d5c05d501c WatchSource:0}: Error finding container e71f252c75ecb7f35223727a684c93055c8eccee2645fb41c94573d5c05d501c: Status 404 returned error can't find the container with id e71f252c75ecb7f35223727a684c93055c8eccee2645fb41c94573d5c05d501c Jul 23 21:30:18.950135 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:18.950084 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:19.037896 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:19.037852 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f27wm" event={"ID":"a7c3140f-42f4-4305-a9de-0f4ab5240702","Type":"ContainerStarted","Data":"e71f252c75ecb7f35223727a684c93055c8eccee2645fb41c94573d5c05d501c"} Jul 23 21:30:19.049912 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:19.049859 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:19.103837 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:19.103806 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:21.047352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:21.047320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zbh6x" event={"ID":"b6390148-2edc-4a19-b84c-6c06a0d79c8e","Type":"ContainerStarted","Data":"bfe19f01aec3d7e411da881b23a7dc616a655c85b2d8b423f45283a738677dde"} Jul 23 21:30:21.066527 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:21.066475 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zbh6x" podStartSLOduration=16.423276566 podStartE2EDuration="28.06646155s" totalImagesPullingTime="11.643184984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:29:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:21.065054217 +0000 UTC m=+254.392742957" watchObservedRunningTime="2026-07-23 21:30:21.06646155 +0000 UTC m=+254.394150265" Jul 23 21:30:22.053433 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:22.053391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f27wm" event={"ID":"a7c3140f-42f4-4305-a9de-0f4ab5240702","Type":"ContainerStarted","Data":"c7c993e706c510e77ef708aa2c1312fb875a9f2a4fe155560621cea157f20ff5"} Jul 23 21:30:22.053826 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:22.053451 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f27wm" event={"ID":"a7c3140f-42f4-4305-a9de-0f4ab5240702","Type":"ContainerStarted","Data":"af6614dd8e8555c552594c688d42d175164d6e015a5643c1226d7fe43e3d870e"} Jul 23 21:30:22.071911 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:22.071864 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f27wm" podStartSLOduration=252.516688513 podStartE2EDuration="4m15.071848569s" totalImagesPullingTime="2.555160056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:22.071294965 +0000 UTC m=+255.398983700" watchObservedRunningTime="2026-07-23 21:30:22.071848569 +0000 UTC m=+255.399537284" Jul 23 21:30:22.163024 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:22.162994 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:22.264735 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:22.264702 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:24.296198 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:24.296170 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:24.394037 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:24.393992 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:24.455968 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:24.455927 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:24.676419 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:24.676300 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:26.676219 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:26.676172 2576 patch_prober.go:28] interesting pod/image-registry-f664b44b-lrnks container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 21:30:26.676577 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:26.676233 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f664b44b-lrnks" podUID="95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 21:30:26.946320 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:26.946241 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:27.501848 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.501817 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:27.517426 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.517399 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp"] Jul 23 21:30:27.519713 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.519698 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:27.523073 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.523054 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 21:30:27.523345 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.523321 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 23 21:30:27.523446 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.523346 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 23 21:30:27.523446 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.523395 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rc95c\"" Jul 23 21:30:27.523446 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.523399 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 21:30:27.523446 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.523328 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 21:30:27.531385 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.531366 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp"] Jul 23 21:30:27.533297 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.533274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22b46968-3a5b-4428-a3ae-3bebf77aac15-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:27.533391 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.533304 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22b46968-3a5b-4428-a3ae-3bebf77aac15-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:27.533391 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.533366 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22b46968-3a5b-4428-a3ae-3bebf77aac15-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:27.533391 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.533386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hld4\" (UniqueName: \"kubernetes.io/projected/22b46968-3a5b-4428-a3ae-3bebf77aac15-kube-api-access-5hld4\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:27.563021 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.562992 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:27.633754 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.633724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22b46968-3a5b-4428-a3ae-3bebf77aac15-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:27.633754 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.633756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22b46968-3a5b-4428-a3ae-3bebf77aac15-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:27.633930 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.633801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22b46968-3a5b-4428-a3ae-3bebf77aac15-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:27.633930 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:30:27.633883 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 23 21:30:27.633930 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.633898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hld4\" (UniqueName: \"kubernetes.io/projected/22b46968-3a5b-4428-a3ae-3bebf77aac15-kube-api-access-5hld4\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:27.634064 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:30:27.633950 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22b46968-3a5b-4428-a3ae-3bebf77aac15-prometheus-operator-tls podName:22b46968-3a5b-4428-a3ae-3bebf77aac15 nodeName:}" failed. No retries permitted until 2026-07-23 21:30:28.133928285 +0000 UTC m=+261.461617007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/22b46968-3a5b-4428-a3ae-3bebf77aac15-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-9fhtp" (UID: "22b46968-3a5b-4428-a3ae-3bebf77aac15") : secret "prometheus-operator-tls" not found Jul 23 21:30:27.634614 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.634565 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22b46968-3a5b-4428-a3ae-3bebf77aac15-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:27.636217 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.636199 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22b46968-3a5b-4428-a3ae-3bebf77aac15-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:27.644000 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:27.643980 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hld4\" (UniqueName: \"kubernetes.io/projected/22b46968-3a5b-4428-a3ae-3bebf77aac15-kube-api-access-5hld4\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:28.035979 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:28.035928 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:28.136050 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:28.136018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22b46968-3a5b-4428-a3ae-3bebf77aac15-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:28.138814 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:28.138791 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22b46968-3a5b-4428-a3ae-3bebf77aac15-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-9fhtp\" (UID: \"22b46968-3a5b-4428-a3ae-3bebf77aac15\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:28.339393 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:28.339280 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:28.403208 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:28.403178 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:28.429115 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:28.429090 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" Jul 23 21:30:28.556602 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:28.556577 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp"] Jul 23 21:30:28.558788 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:30:28.558752 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b46968_3a5b_4428_a3ae_3bebf77aac15.slice/crio-84cfcd3d5d1dbf2e7c53ac00975fd190b8d025b53e8947b062066516afdba2e8 WatchSource:0}: Error finding container 84cfcd3d5d1dbf2e7c53ac00975fd190b8d025b53e8947b062066516afdba2e8: Status 404 returned error can't find the container with id 84cfcd3d5d1dbf2e7c53ac00975fd190b8d025b53e8947b062066516afdba2e8 Jul 23 21:30:29.076422 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:29.076386 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" event={"ID":"22b46968-3a5b-4428-a3ae-3bebf77aac15","Type":"ContainerStarted","Data":"84cfcd3d5d1dbf2e7c53ac00975fd190b8d025b53e8947b062066516afdba2e8"} Jul 23 21:30:29.930227 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:29.930188 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:29.990138 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:29.990072 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:30.042008 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:30.041960 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:30.081545 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:30.081514 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" event={"ID":"22b46968-3a5b-4428-a3ae-3bebf77aac15","Type":"ContainerStarted","Data":"952d6d03db4ea4a82a6e0b0771f9eeaa2cb956c5d332ecca2fee4e966bd9ff5d"} Jul 23 21:30:30.081898 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:30.081564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" event={"ID":"22b46968-3a5b-4428-a3ae-3bebf77aac15","Type":"ContainerStarted","Data":"dc43e06bb1aed7033595f2a0659cf82a067e2c1a9a5c3a82763afb69248416f9"} Jul 23 21:30:30.097074 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:30.097025 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-9fhtp" podStartSLOduration=1.88756517 podStartE2EDuration="3.097007351s" totalImagesPullingTime="1.209442181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:30.096679494 +0000 UTC m=+263.424368237" watchObservedRunningTime="2026-07-23 21:30:30.097007351 +0000 UTC m=+263.424696068" Jul 23 21:30:30.747790 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:30.747755 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:30.819509 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:30.819481 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:31.632083 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.632047 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:31.850147 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.850107 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:31.911291 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.911213 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-85x6b"] Jul 23 21:30:31.913730 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.913715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:31.918266 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.918246 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 21:30:31.918562 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.918544 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tbsf8\"" Jul 23 21:30:31.918618 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.918544 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 21:30:31.918688 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.918650 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 21:30:31.949964 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.949925 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:31.960183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.960161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:31.960331 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.960195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-textfile\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:31.960331 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.960248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9j4q\" (UniqueName: \"kubernetes.io/projected/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-kube-api-access-h9j4q\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:31.960331 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.960301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-tls\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:31.960497 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.960329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:31.960497 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.960376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-sys\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:31.960497 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.960398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-wtmp\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:31.960497 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.960420 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-metrics-client-ca\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:31.960497 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:31.960449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-root\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.014505 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.014485 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:32.060777 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.060753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-sys\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.060878 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.060782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-wtmp\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.060878 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.060803 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-metrics-client-ca\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.060878 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.060826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-root\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.060878 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.060850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.060878 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.060855 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-sys\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.061117 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.060911 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-root\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.061117 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.060929 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-wtmp\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.061117 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.060945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-textfile\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.061117 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.060991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9j4q\" (UniqueName: \"kubernetes.io/projected/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-kube-api-access-h9j4q\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.061117 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.061041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-tls\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.061117 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.061069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.061401 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.061302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-textfile\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.061511 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.061492 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-metrics-client-ca\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.061566 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.061546 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.063393 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.063374 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-tls\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.063480 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.063407 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.069360 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.069339 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9j4q\" (UniqueName: \"kubernetes.io/projected/1c94bbee-d7cc-4fca-8fa1-4acff5f329c6-kube-api-access-h9j4q\") pod \"node-exporter-85x6b\" (UID: \"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6\") " pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.150590 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.150560 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:32.222614 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.222538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-85x6b" Jul 23 21:30:32.232196 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:30:32.232171 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c94bbee_d7cc_4fca_8fa1_4acff5f329c6.slice/crio-c9e73cf097333b2292c20c91fe238ce5c88eff16bcfc92bdbb01a077e88a420b WatchSource:0}: Error finding container c9e73cf097333b2292c20c91fe238ce5c88eff16bcfc92bdbb01a077e88a420b: Status 404 returned error can't find the container with id c9e73cf097333b2292c20c91fe238ce5c88eff16bcfc92bdbb01a077e88a420b Jul 23 21:30:32.394300 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.394262 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:32.859898 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.859863 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:32.937363 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:32.937324 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:33.100032 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:33.099992 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-85x6b" event={"ID":"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6","Type":"ContainerStarted","Data":"c9e73cf097333b2292c20c91fe238ce5c88eff16bcfc92bdbb01a077e88a420b"} Jul 23 21:30:33.216719 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:33.216598 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:33.392626 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:33.392595 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:33.452737 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:33.452683 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:33.567575 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:33.567512 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:34.105746 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:34.105716 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c94bbee-d7cc-4fca-8fa1-4acff5f329c6" containerID="cf394ed5a694063d95cc25c3efe1ee9bd3c50ef35e530246a93172d331132bd7" exitCode=0 Jul 23 21:30:34.106116 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:34.105760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-85x6b" event={"ID":"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6","Type":"ContainerDied","Data":"cf394ed5a694063d95cc25c3efe1ee9bd3c50ef35e530246a93172d331132bd7"} Jul 23 21:30:34.332880 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:34.332838 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:34.434335 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:34.434255 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:34.534668 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:34.534641 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:34.599110 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:34.599080 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:34.830207 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:34.830177 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:34.886902 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:34.886860 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:35.112542 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:35.112454 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-85x6b" event={"ID":"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6","Type":"ContainerStarted","Data":"6021f1fb77802b305293098045b962c26ad336a8e61456c5866c71ae231be0e8"} Jul 23 21:30:35.112542 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:35.112511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-85x6b" event={"ID":"1c94bbee-d7cc-4fca-8fa1-4acff5f329c6","Type":"ContainerStarted","Data":"474a290c527569eda258b23c2212d5bcc595af94c1dffa7dcc8b12a18a1bba0b"} Jul 23 21:30:35.136762 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:35.136713 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-85x6b" podStartSLOduration=3.080857805 podStartE2EDuration="4.136697823s" totalImagesPullingTime="984.567263ms" totalInitContainerRuntime="71.272755ms" isStatefulPod=true podCreationTimestamp="2026-07-23 21:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:35.132513399 +0000 UTC m=+268.460202127" watchObservedRunningTime="2026-07-23 21:30:35.136697823 +0000 UTC m=+268.464386539" Jul 23 21:30:35.340110 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:35.340081 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:35.438802 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:35.438724 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:35.492792 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:35.492758 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:35.564665 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:35.564614 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:36.663129 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.663092 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg"] Jul 23 21:30:36.665445 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.665414 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" Jul 23 21:30:36.666342 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.666304 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:36.667695 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.667675 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 23 21:30:36.667809 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.667771 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fq6cz\"" Jul 23 21:30:36.673911 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.673870 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg"] Jul 23 21:30:36.676148 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.676126 2576 patch_prober.go:28] interesting pod/image-registry-f664b44b-lrnks container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 21:30:36.676231 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.676170 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f664b44b-lrnks" podUID="95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 21:30:36.700045 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.700021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/124b6395-f477-445f-ab6d-d95db8229c1d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-gg8zg\" (UID: \"124b6395-f477-445f-ab6d-d95db8229c1d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" Jul 23 21:30:36.700131 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.700057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b594s\" (UniqueName: \"kubernetes.io/projected/124b6395-f477-445f-ab6d-d95db8229c1d-kube-api-access-b594s\") pod \"monitoring-plugin-7b7b7bc8bf-gg8zg\" (UID: \"124b6395-f477-445f-ab6d-d95db8229c1d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" Jul 23 21:30:36.767118 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.767077 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:36.801301 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.801274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b594s\" (UniqueName: \"kubernetes.io/projected/124b6395-f477-445f-ab6d-d95db8229c1d-kube-api-access-b594s\") pod \"monitoring-plugin-7b7b7bc8bf-gg8zg\" (UID: \"124b6395-f477-445f-ab6d-d95db8229c1d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" Jul 23 21:30:36.801411 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.801346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/124b6395-f477-445f-ab6d-d95db8229c1d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-gg8zg\" (UID: \"124b6395-f477-445f-ab6d-d95db8229c1d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" Jul 23 21:30:36.801484 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:30:36.801431 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 23 21:30:36.801541 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:30:36.801489 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/124b6395-f477-445f-ab6d-d95db8229c1d-monitoring-plugin-cert podName:124b6395-f477-445f-ab6d-d95db8229c1d nodeName:}" failed. No retries permitted until 2026-07-23 21:30:37.301471405 +0000 UTC m=+270.629160117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/124b6395-f477-445f-ab6d-d95db8229c1d-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-gg8zg" (UID: "124b6395-f477-445f-ab6d-d95db8229c1d") : secret "monitoring-plugin-cert" not found Jul 23 21:30:36.809718 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:36.809690 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b594s\" (UniqueName: \"kubernetes.io/projected/124b6395-f477-445f-ab6d-d95db8229c1d-kube-api-access-b594s\") pod \"monitoring-plugin-7b7b7bc8bf-gg8zg\" (UID: \"124b6395-f477-445f-ab6d-d95db8229c1d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" Jul 23 21:30:37.036649 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.036610 2576 patch_prober.go:28] interesting pod/image-registry-677bd4fbc7-xgdst container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 21:30:37.036799 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.036670 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" podUID="fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 21:30:37.194307 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.194276 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:37.194458 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.194320 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-856589ddb5-drw57"] Jul 23 21:30:37.197060 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.197045 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.200599 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.200575 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 23 21:30:37.200726 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.200652 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 21:30:37.200808 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.200781 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2ih86l9pairkk\"" Jul 23 21:30:37.200950 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.200901 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 23 21:30:37.200950 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.200915 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pgdcq\"" Jul 23 21:30:37.200950 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.200915 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 23 21:30:37.204417 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.204384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-metrics-server-audit-profiles\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.204537 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.204443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-secret-metrics-server-client-certs\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.204537 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.204468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-client-ca-bundle\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.204537 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.204509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.204537 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.204535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-secret-metrics-server-tls\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.204856 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.204550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-audit-log\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.204856 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.204570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndhsr\" (UniqueName: \"kubernetes.io/projected/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-kube-api-access-ndhsr\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.208165 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.208140 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-856589ddb5-drw57"] Jul 23 21:30:37.305306 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.305233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-metrics-server-audit-profiles\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.305306 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.305276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-secret-metrics-server-client-certs\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.305306 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.305303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-client-ca-bundle\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.305572 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.305335 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/124b6395-f477-445f-ab6d-d95db8229c1d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-gg8zg\" (UID: \"124b6395-f477-445f-ab6d-d95db8229c1d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" Jul 23 21:30:37.305572 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.305359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.305572 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.305392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-secret-metrics-server-tls\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.305572 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.305417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-audit-log\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.305572 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.305442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndhsr\" (UniqueName: \"kubernetes.io/projected/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-kube-api-access-ndhsr\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.305883 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.305856 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-audit-log\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.306392 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.306300 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.306600 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.306578 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-metrics-server-audit-profiles\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.307974 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.307949 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-secret-metrics-server-client-certs\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.308149 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.308130 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-client-ca-bundle\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.308191 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.308129 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/124b6395-f477-445f-ab6d-d95db8229c1d-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-gg8zg\" (UID: \"124b6395-f477-445f-ab6d-d95db8229c1d\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" Jul 23 21:30:37.308224 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.308205 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-secret-metrics-server-tls\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.313201 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.313173 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndhsr\" (UniqueName: \"kubernetes.io/projected/06d46f0e-e98f-4d08-86ab-1b0a96b30de9-kube-api-access-ndhsr\") pod \"metrics-server-856589ddb5-drw57\" (UID: \"06d46f0e-e98f-4d08-86ab-1b0a96b30de9\") " pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.507126 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.507086 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:37.576126 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.576057 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" Jul 23 21:30:37.641157 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.641128 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-856589ddb5-drw57"] Jul 23 21:30:37.643545 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:30:37.643520 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d46f0e_e98f_4d08_86ab_1b0a96b30de9.slice/crio-6f34dfc1cfa91c0a4e63bcab3cdcda15c52649288f0c813189ffde4cfcbbecaf WatchSource:0}: Error finding container 6f34dfc1cfa91c0a4e63bcab3cdcda15c52649288f0c813189ffde4cfcbbecaf: Status 404 returned error can't find the container with id 6f34dfc1cfa91c0a4e63bcab3cdcda15c52649288f0c813189ffde4cfcbbecaf Jul 23 21:30:37.707174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:37.707150 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg"] Jul 23 21:30:37.709422 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:30:37.709398 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124b6395_f477_445f_ab6d_d95db8229c1d.slice/crio-b9bbc9b8fce5b0b6f7b0723ef418528e703e79a31e56ec51c8757c0d86ff1796 WatchSource:0}: Error finding container b9bbc9b8fce5b0b6f7b0723ef418528e703e79a31e56ec51c8757c0d86ff1796: Status 404 returned error can't find the container with id b9bbc9b8fce5b0b6f7b0723ef418528e703e79a31e56ec51c8757c0d86ff1796 Jul 23 21:30:38.094588 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.094549 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:38.100361 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.100337 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 21:30:38.104564 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.104541 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.107573 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.107325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 21:30:38.107703 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.107403 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7sdujg89pmkg5\"" Jul 23 21:30:38.107801 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.107413 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 21:30:38.107912 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.107502 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 21:30:38.107994 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.107547 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-f78wd\"" Jul 23 21:30:38.108105 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.107554 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 21:30:38.108470 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.108335 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 21:30:38.108470 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.108349 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 21:30:38.108666 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.108646 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 21:30:38.109120 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.109099 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 21:30:38.109295 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.109277 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 21:30:38.109370 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.109344 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 21:30:38.109471 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.109452 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 21:30:38.109690 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.109673 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 21:30:38.109752 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.109679 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 21:30:38.111515 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.111495 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 21:30:38.112306 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-web-config\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.112414 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-config\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.112414 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.112414 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.112559 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b690384c-021c-4301-9d1f-e8bb0e3b4d83-config-out\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.112559 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.112559 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112491 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.112559 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.112559 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.112807 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.112807 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b690384c-021c-4301-9d1f-e8bb0e3b4d83-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.112807 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.112807 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.113250 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.113250 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112850 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9244\" (UniqueName: \"kubernetes.io/projected/b690384c-021c-4301-9d1f-e8bb0e3b4d83-kube-api-access-p9244\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.113250 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.113250 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.113250 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.112961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.113250 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.113051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.113250 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.113088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.125326 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.125294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" event={"ID":"124b6395-f477-445f-ab6d-d95db8229c1d","Type":"ContainerStarted","Data":"b9bbc9b8fce5b0b6f7b0723ef418528e703e79a31e56ec51c8757c0d86ff1796"} Jul 23 21:30:38.126882 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.126853 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-856589ddb5-drw57" event={"ID":"06d46f0e-e98f-4d08-86ab-1b0a96b30de9","Type":"ContainerStarted","Data":"6f34dfc1cfa91c0a4e63bcab3cdcda15c52649288f0c813189ffde4cfcbbecaf"} Jul 23 21:30:38.132660 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.132613 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 21:30:38.214004 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.213972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214004 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214011 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214247 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-web-config\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214247 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-config\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214247 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214247 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214247 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b690384c-021c-4301-9d1f-e8bb0e3b4d83-config-out\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214247 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214247 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214247 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214247 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214240 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b690384c-021c-4301-9d1f-e8bb0e3b4d83-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9244\" (UniqueName: \"kubernetes.io/projected/b690384c-021c-4301-9d1f-e8bb0e3b4d83-kube-api-access-p9244\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.214661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.217466 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.214625 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.217466 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.215156 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.217466 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.215446 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.217466 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.216002 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.217466 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.216322 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.217466 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.216690 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.217466 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.216901 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.217838 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.217646 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-web-config\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.218433 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.218402 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b690384c-021c-4301-9d1f-e8bb0e3b4d83-config-out\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.219152 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.219098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.220841 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.220818 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.221112 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.221091 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.221217 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.221176 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.221555 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.221529 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-config\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.221667 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.221587 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.221793 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.221684 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.221793 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.221694 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.221978 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.221949 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b690384c-021c-4301-9d1f-e8bb0e3b4d83-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.223596 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.223579 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.228084 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.228065 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9244\" (UniqueName: \"kubernetes.io/projected/b690384c-021c-4301-9d1f-e8bb0e3b4d83-kube-api-access-p9244\") pod \"prometheus-k8s-0\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.415660 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.415558 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:38.604828 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:38.604277 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 21:30:38.607984 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:30:38.607946 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb690384c_021c_4301_9d1f_e8bb0e3b4d83.slice/crio-dfc4a7db9abb330a554e7a4e31e2b70d8282e756f81bbc2efd9b7c789a2e9d35 WatchSource:0}: Error finding container dfc4a7db9abb330a554e7a4e31e2b70d8282e756f81bbc2efd9b7c789a2e9d35: Status 404 returned error can't find the container with id dfc4a7db9abb330a554e7a4e31e2b70d8282e756f81bbc2efd9b7c789a2e9d35 Jul 23 21:30:39.043342 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:39.043292 2576 patch_prober.go:28] interesting pod/image-registry-677bd4fbc7-xgdst container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 21:30:39.043798 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:39.043348 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" podUID="fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 21:30:39.131799 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:39.131762 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerStarted","Data":"dfc4a7db9abb330a554e7a4e31e2b70d8282e756f81bbc2efd9b7c789a2e9d35"} Jul 23 21:30:40.137406 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:40.137371 2576 generic.go:356] "Generic (PLEG): container finished" podID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerID="03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b" exitCode=0 Jul 23 21:30:40.137875 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:40.137462 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerDied","Data":"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b"} Jul 23 21:30:40.139008 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:40.138969 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" event={"ID":"124b6395-f477-445f-ab6d-d95db8229c1d","Type":"ContainerStarted","Data":"9da167bc3b3a84eff3cf84b9f4721b1a4d4390f82fa68d3c4378a4f8b564ee1e"} Jul 23 21:30:40.139339 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:40.139214 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" Jul 23 21:30:40.140692 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:40.140600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-856589ddb5-drw57" event={"ID":"06d46f0e-e98f-4d08-86ab-1b0a96b30de9","Type":"ContainerStarted","Data":"6f2cbb537f5025b41916d446c28d75f792dad215eb11e58c94d43c8e942f3584"} Jul 23 21:30:40.144319 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:40.144296 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" Jul 23 21:30:40.183967 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:40.183910 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-856589ddb5-drw57" podStartSLOduration=1.414138195 podStartE2EDuration="3.183891806s" totalImagesPullingTime="1.769753611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:40.183579865 +0000 UTC m=+273.511268603" watchObservedRunningTime="2026-07-23 21:30:40.183891806 +0000 UTC m=+273.511580521" Jul 23 21:30:40.198223 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:40.198130 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-gg8zg" podStartSLOduration=2.492794623 podStartE2EDuration="4.198117704s" totalImagesPullingTime="1.705323081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:40.197388552 +0000 UTC m=+273.525077279" watchObservedRunningTime="2026-07-23 21:30:40.198117704 +0000 UTC m=+273.525806422" Jul 23 21:30:40.984924 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:40.984887 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:41.086812 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:41.086776 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:41.694193 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:41.694153 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f664b44b-lrnks" podUID="95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" containerName="registry" containerID="cri-o://7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992" gracePeriod=30 Jul 23 21:30:41.956978 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:41.956913 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:30:42.051594 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.051559 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-image-registry-private-configuration\") pod \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " Jul 23 21:30:42.051791 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.051619 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-certificates\") pod \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " Jul 23 21:30:42.051791 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.051661 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvkgw\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-kube-api-access-mvkgw\") pod \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " Jul 23 21:30:42.051791 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.051778 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls\") pod \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " Jul 23 21:30:42.051956 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.051861 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-installation-pull-secrets\") pod \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " Jul 23 21:30:42.051956 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.051900 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-trusted-ca\") pod \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " Jul 23 21:30:42.051956 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.051932 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-ca-trust-extracted\") pod \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " Jul 23 21:30:42.052099 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.052015 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:30:42.057212 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.057172 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:30:42.063430 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.057998 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-bound-sa-token\") pod \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\" (UID: \"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf\") " Jul 23 21:30:42.063430 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.058449 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-trusted-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:30:42.063430 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.058475 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-certificates\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:30:42.063430 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.058742 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:30:42.063430 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.060001 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:30:42.063430 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.060016 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:30:42.063430 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.060075 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-kube-api-access-mvkgw" (OuterVolumeSpecName: "kube-api-access-mvkgw") pod "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf"). InnerVolumeSpecName "kube-api-access-mvkgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:30:42.063430 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.062399 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:30:42.064804 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.064775 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" (UID: "95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:30:42.150664 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.150614 2576 generic.go:356] "Generic (PLEG): container finished" podID="95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" containerID="7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992" exitCode=0 Jul 23 21:30:42.150834 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.150702 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f664b44b-lrnks" event={"ID":"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf","Type":"ContainerDied","Data":"7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992"} Jul 23 21:30:42.150834 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.150710 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f664b44b-lrnks" Jul 23 21:30:42.150834 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.150785 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f664b44b-lrnks" event={"ID":"95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf","Type":"ContainerDied","Data":"f49dbddbbc47b604242684e71ef86f96495bd2a70f801030cde49b56fa9677ff"} Jul 23 21:30:42.150834 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.150813 2576 scope.go:117] "RemoveContainer" containerID="7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992" Jul 23 21:30:42.158966 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.158945 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvkgw\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-kube-api-access-mvkgw\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:30:42.158966 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.158965 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-registry-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:30:42.159098 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.158976 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-installation-pull-secrets\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:30:42.159098 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.158984 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-ca-trust-extracted\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:30:42.159098 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.158992 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-bound-sa-token\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:30:42.159098 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.159001 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf-image-registry-private-configuration\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:30:42.171188 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.171158 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f664b44b-lrnks"] Jul 23 21:30:42.175458 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:42.175435 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f664b44b-lrnks"] Jul 23 21:30:43.083978 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:43.083951 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:43.142770 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:43.142733 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:43.198173 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:43.198097 2576 scope.go:117] "RemoveContainer" containerID="7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992" Jul 23 21:30:43.198449 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:30:43.198428 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992\": container with ID starting with 7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992 not found: ID does not exist" containerID="7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992" Jul 23 21:30:43.198521 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:43.198458 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992"} err="failed to get container status \"7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992\": rpc error: code = NotFound desc = could not find container \"7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992\": container with ID starting with 7eab1a8b3a99ab3719e10f85833034a8349c5cc9798ac3aa02de3c29caa84992 not found: ID does not exist" Jul 23 21:30:43.248250 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:43.248215 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" path="/var/lib/kubelet/pods/95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf/volumes" Jul 23 21:30:44.165346 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:44.165305 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerStarted","Data":"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90"} Jul 23 21:30:44.165787 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:44.165382 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerStarted","Data":"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29"} Jul 23 21:30:46.176944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:46.176900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerStarted","Data":"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec"} Jul 23 21:30:46.177399 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:46.176978 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerStarted","Data":"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd"} Jul 23 21:30:46.177399 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:46.177018 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerStarted","Data":"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059"} Jul 23 21:30:46.177399 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:46.177056 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerStarted","Data":"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9"} Jul 23 21:30:46.210332 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:46.210280 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.8465878249999998 podStartE2EDuration="8.210258519s" totalImagesPullingTime="6.345140536s" totalInitContainerRuntime="18.530158ms" isStatefulPod=false podCreationTimestamp="2026-07-23 21:30:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:46.208136472 +0000 UTC m=+279.535825213" watchObservedRunningTime="2026-07-23 21:30:46.210258519 +0000 UTC m=+279.537947238" Jul 23 21:30:47.036484 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:47.036451 2576 patch_prober.go:28] interesting pod/image-registry-677bd4fbc7-xgdst container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 21:30:47.036642 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:47.036514 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" podUID="fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 21:30:48.416718 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:48.416678 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:30:48.767425 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:30:48.767332 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-665rd" podUID="6e846bbf-3d90-4e9c-b16d-781db1c99dc8" Jul 23 21:30:49.042601 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:49.042574 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-677bd4fbc7-xgdst" Jul 23 21:30:49.167343 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:49.167304 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:49.188208 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:49.188179 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-665rd" Jul 23 21:30:49.268859 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:49.268828 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:49.591930 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:49.591892 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:49.649700 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:49.649669 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:50.555464 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:50.555429 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:50.606313 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:50.606282 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:51.950476 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:51.950438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:30:51.952972 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:51.952947 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e846bbf-3d90-4e9c-b16d-781db1c99dc8-metrics-tls\") pod \"dns-default-665rd\" (UID: \"6e846bbf-3d90-4e9c-b16d-781db1c99dc8\") " pod="openshift-dns/dns-default-665rd" Jul 23 21:30:52.191373 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:52.191345 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-47mvm\"" Jul 23 21:30:52.199625 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:52.199603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-665rd" Jul 23 21:30:52.383150 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:52.383070 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-665rd"] Jul 23 21:30:52.385746 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:30:52.385722 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e846bbf_3d90_4e9c_b16d_781db1c99dc8.slice/crio-353d4543012ad703c5603b319080da4767366e046593f0ca0aff059e25f75b02 WatchSource:0}: Error finding container 353d4543012ad703c5603b319080da4767366e046593f0ca0aff059e25f75b02: Status 404 returned error can't find the container with id 353d4543012ad703c5603b319080da4767366e046593f0ca0aff059e25f75b02 Jul 23 21:30:53.181914 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:53.181874 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:53.205915 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:53.205877 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-665rd" event={"ID":"6e846bbf-3d90-4e9c-b16d-781db1c99dc8","Type":"ContainerStarted","Data":"353d4543012ad703c5603b319080da4767366e046593f0ca0aff059e25f75b02"} Jul 23 21:30:53.281660 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:53.281600 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:53.518509 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:53.518439 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:53.621588 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:53.621518 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:55.215888 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:55.215855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-665rd" event={"ID":"6e846bbf-3d90-4e9c-b16d-781db1c99dc8","Type":"ContainerStarted","Data":"791dc0b750b41d8fb0f244cf741481631275f60ba78ccf33bf9d67e74a3b7abc"} Jul 23 21:30:55.216344 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:55.215903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-665rd" event={"ID":"6e846bbf-3d90-4e9c-b16d-781db1c99dc8","Type":"ContainerStarted","Data":"9795ed3a75f056d1c4f20ac89c6bf74c42cd8584fe36217488b5322dec12e22e"} Jul 23 21:30:55.216344 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:55.215991 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-665rd" Jul 23 21:30:55.233889 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:55.233844 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-665rd" podStartSLOduration=252.396009821 podStartE2EDuration="4m14.233830863s" totalImagesPullingTime="1.837821042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:30:55.232478251 +0000 UTC m=+288.560166968" watchObservedRunningTime="2026-07-23 21:30:55.233830863 +0000 UTC m=+288.561519580" Jul 23 21:30:55.337386 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:55.337353 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:55.437910 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:55.437872 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:57.507518 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:57.507485 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:57.508002 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:57.507542 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:30:57.726742 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:57.726707 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:57.932323 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:57.932293 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:58.033797 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:58.033760 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:58.132908 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:58.132878 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:58.233610 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:58.233530 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:58.692079 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:58.692048 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:30:58.791677 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:30:58.791623 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:31:05.222230 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:05.222201 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-665rd" Jul 23 21:31:07.096079 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:07.096055 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5j52_01dab5b8-48b4-4745-8526-c822fa9110a2/ovn-acl-logging/0.log" Jul 23 21:31:07.096448 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:07.096055 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5j52_01dab5b8-48b4-4745-8526-c822fa9110a2/ovn-acl-logging/0.log" Jul 23 21:31:07.100956 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:07.100938 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 21:31:08.263661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:08.263563 2576 generic.go:356] "Generic (PLEG): container finished" podID="a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f" containerID="6fcf9bcb766a89aaaf841273c4fa8868c90df9e8b38998e4a185cfcacfcd00f1" exitCode=0 Jul 23 21:31:08.264032 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:08.263654 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vwkpc" event={"ID":"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f","Type":"ContainerDied","Data":"6fcf9bcb766a89aaaf841273c4fa8868c90df9e8b38998e4a185cfcacfcd00f1"} Jul 23 21:31:08.264032 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:08.264019 2576 scope.go:117] "RemoveContainer" containerID="6fcf9bcb766a89aaaf841273c4fa8868c90df9e8b38998e4a185cfcacfcd00f1" Jul 23 21:31:09.050409 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:09.050381 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-665rd_6e846bbf-3d90-4e9c-b16d-781db1c99dc8/dns/0.log" Jul 23 21:31:09.230149 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:09.230119 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-665rd_6e846bbf-3d90-4e9c-b16d-781db1c99dc8/kube-rbac-proxy/0.log" Jul 23 21:31:09.268791 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:09.268760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vwkpc" event={"ID":"a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f","Type":"ContainerStarted","Data":"fc3f9213bdfdffe89d2149acb94697c633ee9b9a856b902dd67813c855896bc2"} Jul 23 21:31:10.256590 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:10.256543 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:31:10.312058 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:10.312021 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:31:10.426617 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:10.426587 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qzzbv_9dd834fa-cfaf-4978-8827-e8885dde51fc/dns-node-resolver/0.log" Jul 23 21:31:11.026878 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:11.026848 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-998p4_cabbcb56-db1a-47bf-a01e-3e5e96c10812/serve-healthcheck-canary/0.log" Jul 23 21:31:13.082746 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:13.082715 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:31:13.136547 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:13.136512 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:31:17.513339 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:17.513304 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:31:17.517050 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:17.517026 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-856589ddb5-drw57" Jul 23 21:31:19.254307 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:19.254274 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:31:27.337098 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:27.337066 2576 generic.go:356] "Generic (PLEG): container finished" podID="38982c0c-81bb-4ea2-be6c-b9406f68c744" containerID="69a986a2181de880224d5ebec470e6ea54e8e08d4a1b81cb4c9602d51105866a" exitCode=0 Jul 23 21:31:27.337462 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:27.337128 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" event={"ID":"38982c0c-81bb-4ea2-be6c-b9406f68c744","Type":"ContainerDied","Data":"69a986a2181de880224d5ebec470e6ea54e8e08d4a1b81cb4c9602d51105866a"} Jul 23 21:31:27.337500 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:27.337459 2576 scope.go:117] "RemoveContainer" containerID="69a986a2181de880224d5ebec470e6ea54e8e08d4a1b81cb4c9602d51105866a" Jul 23 21:31:28.342158 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:28.342126 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9gqdg" event={"ID":"38982c0c-81bb-4ea2-be6c-b9406f68c744","Type":"ContainerStarted","Data":"2646897e4e71acbde4eb4827088caae55421cbf46682235d004b5d254a16da74"} Jul 23 21:31:35.107487 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:35.107455 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:31:35.205320 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:35.205271 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:31:35.256930 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:35.256898 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:31:38.416482 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:38.416453 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:38.436580 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:38.436556 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:39.399943 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:39.399904 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:51.183667 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:51.183593 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:31:51.461083 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:51.460972 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:31:56.573560 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.573521 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 21:31:56.574004 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.573932 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="prometheus" containerID="cri-o://313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29" gracePeriod=600 Jul 23 21:31:56.574004 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.573960 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="kube-rbac-proxy-web" containerID="cri-o://cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059" gracePeriod=600 Jul 23 21:31:56.574136 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.573985 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="thanos-sidecar" containerID="cri-o://47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9" gracePeriod=600 Jul 23 21:31:56.574136 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.574009 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="kube-rbac-proxy" containerID="cri-o://674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd" gracePeriod=600 Jul 23 21:31:56.574136 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.574048 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec" gracePeriod=600 Jul 23 21:31:56.574136 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.573993 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="config-reloader" containerID="cri-o://41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90" gracePeriod=600 Jul 23 21:31:56.834034 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.834007 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:56.999463 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.999428 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-serving-certs-ca-bundle\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:56.999686 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.999479 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-kube-rbac-proxy\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:56.999686 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.999512 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-grpc-tls\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:56.999686 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.999536 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-trusted-ca-bundle\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:56.999686 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.999564 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b690384c-021c-4301-9d1f-e8bb0e3b4d83-config-out\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:56.999686 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.999585 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-2\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:56.999686 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.999618 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-kubelet-serving-ca-bundle\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:56.999686 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.999656 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b690384c-021c-4301-9d1f-e8bb0e3b4d83-tls-assets\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.000043 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:56.999884 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:57.000143 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000111 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:57.000297 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000204 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:57.000557 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000371 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9244\" (UniqueName: \"kubernetes.io/projected/b690384c-021c-4301-9d1f-e8bb0e3b4d83-kube-api-access-p9244\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.000722 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000698 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.000823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000739 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-db\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.000823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000771 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.000823 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000804 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-metrics-client-certs\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.000974 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000851 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-1\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.000974 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000889 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-web-config\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.000974 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000913 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-metrics-client-ca\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.000974 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000945 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-thanos-prometheus-http-client-file\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.000974 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000971 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-config\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.001203 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.000993 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-tls\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.001203 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.001029 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-0\") pod \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\" (UID: \"b690384c-021c-4301-9d1f-e8bb0e3b4d83\") " Jul 23 21:31:57.001334 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.001313 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.001395 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.001338 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.001395 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.001352 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.001395 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.001017 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:57.002409 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.002376 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:57.002793 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.002762 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:57.002883 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.002848 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:57.002947 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.002898 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b690384c-021c-4301-9d1f-e8bb0e3b4d83-config-out" (OuterVolumeSpecName: "config-out") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:31:57.003509 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.003478 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b690384c-021c-4301-9d1f-e8bb0e3b4d83-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:31:57.003742 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.003694 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b690384c-021c-4301-9d1f-e8bb0e3b4d83-kube-api-access-p9244" (OuterVolumeSpecName: "kube-api-access-p9244") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "kube-api-access-p9244". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:31:57.004400 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.004320 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:57.004400 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.004338 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:57.004613 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.004587 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 21:31:57.004701 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.004608 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:57.004757 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.004704 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:31:57.004917 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.004899 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-config" (OuterVolumeSpecName: "config") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:57.005340 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.005311 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:57.005573 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.005551 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:57.006139 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.006113 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:57.014847 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.014828 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-web-config" (OuterVolumeSpecName: "web-config") pod "b690384c-021c-4301-9d1f-e8bb0e3b4d83" (UID: "b690384c-021c-4301-9d1f-e8bb0e3b4d83"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 21:31:57.102472 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102402 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-config\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102472 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102427 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102472 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102437 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102472 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102446 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-kube-rbac-proxy\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102472 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102454 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-grpc-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102472 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102462 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b690384c-021c-4301-9d1f-e8bb0e3b4d83-config-out\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102472 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102471 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102789 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102479 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b690384c-021c-4301-9d1f-e8bb0e3b4d83-tls-assets\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102789 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102488 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9244\" (UniqueName: \"kubernetes.io/projected/b690384c-021c-4301-9d1f-e8bb0e3b4d83-kube-api-access-p9244\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102789 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102497 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102789 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102505 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-db\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102789 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102513 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102789 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102521 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-secret-metrics-client-certs\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102789 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102529 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102789 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102536 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-web-config\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102789 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102544 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b690384c-021c-4301-9d1f-e8bb0e3b4d83-configmap-metrics-client-ca\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.102789 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.102551 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b690384c-021c-4301-9d1f-e8bb0e3b4d83-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:31:57.457418 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457326 2576 generic.go:356] "Generic (PLEG): container finished" podID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerID="a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec" exitCode=0 Jul 23 21:31:57.457418 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457353 2576 generic.go:356] "Generic (PLEG): container finished" podID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerID="674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd" exitCode=0 Jul 23 21:31:57.457418 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457360 2576 generic.go:356] "Generic (PLEG): container finished" podID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerID="cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059" exitCode=0 Jul 23 21:31:57.457418 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457366 2576 generic.go:356] "Generic (PLEG): container finished" podID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerID="47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9" exitCode=0 Jul 23 21:31:57.457418 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457370 2576 generic.go:356] "Generic (PLEG): container finished" podID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerID="41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90" exitCode=0 Jul 23 21:31:57.457418 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457376 2576 generic.go:356] "Generic (PLEG): container finished" podID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerID="313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29" exitCode=0 Jul 23 21:31:57.457418 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457412 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerDied","Data":"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec"} Jul 23 21:31:57.457872 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457433 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.457872 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457481 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerDied","Data":"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd"} Jul 23 21:31:57.457872 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerDied","Data":"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059"} Jul 23 21:31:57.457872 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457533 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerDied","Data":"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9"} Jul 23 21:31:57.457872 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457546 2576 scope.go:117] "RemoveContainer" containerID="a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec" Jul 23 21:31:57.457872 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerDied","Data":"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90"} Jul 23 21:31:57.457872 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerDied","Data":"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29"} Jul 23 21:31:57.457872 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.457604 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b690384c-021c-4301-9d1f-e8bb0e3b4d83","Type":"ContainerDied","Data":"dfc4a7db9abb330a554e7a4e31e2b70d8282e756f81bbc2efd9b7c789a2e9d35"} Jul 23 21:31:57.465344 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.465327 2576 scope.go:117] "RemoveContainer" containerID="674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd" Jul 23 21:31:57.472864 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.472850 2576 scope.go:117] "RemoveContainer" containerID="cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059" Jul 23 21:31:57.479287 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.479270 2576 scope.go:117] "RemoveContainer" containerID="47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9" Jul 23 21:31:57.481769 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.481747 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 21:31:57.485677 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.485657 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 21:31:57.486619 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.486604 2576 scope.go:117] "RemoveContainer" containerID="41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90" Jul 23 21:31:57.493203 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.493186 2576 scope.go:117] "RemoveContainer" containerID="313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29" Jul 23 21:31:57.500332 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.500316 2576 scope.go:117] "RemoveContainer" containerID="03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b" Jul 23 21:31:57.507527 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.507509 2576 scope.go:117] "RemoveContainer" containerID="a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec" Jul 23 21:31:57.507813 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:31:57.507793 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": container with ID starting with a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec not found: ID does not exist" containerID="a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec" Jul 23 21:31:57.507883 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.507821 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec"} err="failed to get container status \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": rpc error: code = NotFound desc = could not find container \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": container with ID starting with a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec not found: ID does not exist" Jul 23 21:31:57.507883 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.507839 2576 scope.go:117] "RemoveContainer" containerID="674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd" Jul 23 21:31:57.508122 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:31:57.508103 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": container with ID starting with 674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd not found: ID does not exist" containerID="674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd" Jul 23 21:31:57.508188 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.508132 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd"} err="failed to get container status \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": rpc error: code = NotFound desc = could not find container \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": container with ID starting with 674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd not found: ID does not exist" Jul 23 21:31:57.508188 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.508157 2576 scope.go:117] "RemoveContainer" containerID="cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059" Jul 23 21:31:57.508434 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:31:57.508417 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": container with ID starting with cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059 not found: ID does not exist" containerID="cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059" Jul 23 21:31:57.508508 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.508437 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059"} err="failed to get container status \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": rpc error: code = NotFound desc = could not find container \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": container with ID starting with cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059 not found: ID does not exist" Jul 23 21:31:57.508508 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.508451 2576 scope.go:117] "RemoveContainer" containerID="47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9" Jul 23 21:31:57.508729 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:31:57.508711 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": container with ID starting with 47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9 not found: ID does not exist" containerID="47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9" Jul 23 21:31:57.508777 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.508737 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9"} err="failed to get container status \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": rpc error: code = NotFound desc = could not find container \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": container with ID starting with 47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9 not found: ID does not exist" Jul 23 21:31:57.508777 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.508763 2576 scope.go:117] "RemoveContainer" containerID="41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90" Jul 23 21:31:57.509005 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:31:57.508985 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": container with ID starting with 41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90 not found: ID does not exist" containerID="41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90" Jul 23 21:31:57.509039 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.509014 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90"} err="failed to get container status \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": rpc error: code = NotFound desc = could not find container \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": container with ID starting with 41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90 not found: ID does not exist" Jul 23 21:31:57.509039 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.509033 2576 scope.go:117] "RemoveContainer" containerID="313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29" Jul 23 21:31:57.509372 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:31:57.509269 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": container with ID starting with 313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29 not found: ID does not exist" containerID="313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29" Jul 23 21:31:57.509372 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.509296 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29"} err="failed to get container status \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": rpc error: code = NotFound desc = could not find container \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": container with ID starting with 313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29 not found: ID does not exist" Jul 23 21:31:57.509372 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.509314 2576 scope.go:117] "RemoveContainer" containerID="03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b" Jul 23 21:31:57.509773 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:31:57.509579 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": container with ID starting with 03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b not found: ID does not exist" containerID="03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b" Jul 23 21:31:57.509773 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.509607 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b"} err="failed to get container status \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": rpc error: code = NotFound desc = could not find container \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": container with ID starting with 03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b not found: ID does not exist" Jul 23 21:31:57.509978 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.509626 2576 scope.go:117] "RemoveContainer" containerID="a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec" Jul 23 21:31:57.510270 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.510247 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec"} err="failed to get container status \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": rpc error: code = NotFound desc = could not find container \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": container with ID starting with a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec not found: ID does not exist" Jul 23 21:31:57.510270 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.510271 2576 scope.go:117] "RemoveContainer" containerID="674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd" Jul 23 21:31:57.510518 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.510497 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd"} err="failed to get container status \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": rpc error: code = NotFound desc = could not find container \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": container with ID starting with 674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd not found: ID does not exist" Jul 23 21:31:57.510595 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.510519 2576 scope.go:117] "RemoveContainer" containerID="cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059" Jul 23 21:31:57.510796 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.510778 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059"} err="failed to get container status \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": rpc error: code = NotFound desc = could not find container \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": container with ID starting with cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059 not found: ID does not exist" Jul 23 21:31:57.510796 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.510796 2576 scope.go:117] "RemoveContainer" containerID="47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9" Jul 23 21:31:57.511027 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511010 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9"} err="failed to get container status \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": rpc error: code = NotFound desc = could not find container \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": container with ID starting with 47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9 not found: ID does not exist" Jul 23 21:31:57.511099 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511027 2576 scope.go:117] "RemoveContainer" containerID="41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90" Jul 23 21:31:57.511259 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511232 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90"} err="failed to get container status \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": rpc error: code = NotFound desc = could not find container \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": container with ID starting with 41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90 not found: ID does not exist" Jul 23 21:31:57.511355 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511261 2576 scope.go:117] "RemoveContainer" containerID="313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29" Jul 23 21:31:57.511417 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511365 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 21:31:57.511519 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511488 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29"} err="failed to get container status \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": rpc error: code = NotFound desc = could not find container \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": container with ID starting with 313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29 not found: ID does not exist" Jul 23 21:31:57.511519 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511519 2576 scope.go:117] "RemoveContainer" containerID="03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b" Jul 23 21:31:57.511688 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511674 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="kube-rbac-proxy-web" Jul 23 21:31:57.511741 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511690 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="kube-rbac-proxy-web" Jul 23 21:31:57.511741 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511700 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="prometheus" Jul 23 21:31:57.511741 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511707 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="prometheus" Jul 23 21:31:57.511741 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511714 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="config-reloader" Jul 23 21:31:57.511741 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511719 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="config-reloader" Jul 23 21:31:57.511741 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511737 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="kube-rbac-proxy" Jul 23 21:31:57.511961 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511745 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="kube-rbac-proxy" Jul 23 21:31:57.511961 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511753 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" containerName="registry" Jul 23 21:31:57.511961 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511758 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" containerName="registry" Jul 23 21:31:57.511961 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511762 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="kube-rbac-proxy-thanos" Jul 23 21:31:57.511961 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511767 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="kube-rbac-proxy-thanos" Jul 23 21:31:57.511961 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511776 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="init-config-reloader" Jul 23 21:31:57.511961 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511785 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="init-config-reloader" Jul 23 21:31:57.511961 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511788 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b"} err="failed to get container status \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": rpc error: code = NotFound desc = could not find container \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": container with ID starting with 03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b not found: ID does not exist" Jul 23 21:31:57.511961 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511818 2576 scope.go:117] "RemoveContainer" containerID="a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec" Jul 23 21:31:57.511961 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511797 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="thanos-sidecar" Jul 23 21:31:57.511961 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511872 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="thanos-sidecar" Jul 23 21:31:57.512353 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511967 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="kube-rbac-proxy-thanos" Jul 23 21:31:57.512353 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511984 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="config-reloader" Jul 23 21:31:57.512353 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.511992 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="thanos-sidecar" Jul 23 21:31:57.512353 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512000 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="kube-rbac-proxy" Jul 23 21:31:57.512353 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512007 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="kube-rbac-proxy-web" Jul 23 21:31:57.512353 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512015 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" containerName="prometheus" Jul 23 21:31:57.512353 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512024 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="95ed6ed5-ff61-42bd-b4f5-e894b8e10ebf" containerName="registry" Jul 23 21:31:57.512353 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512061 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec"} err="failed to get container status \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": rpc error: code = NotFound desc = could not find container \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": container with ID starting with a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec not found: ID does not exist" Jul 23 21:31:57.512353 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512086 2576 scope.go:117] "RemoveContainer" containerID="674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd" Jul 23 21:31:57.512353 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512277 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd"} err="failed to get container status \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": rpc error: code = NotFound desc = could not find container \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": container with ID starting with 674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd not found: ID does not exist" Jul 23 21:31:57.512353 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512296 2576 scope.go:117] "RemoveContainer" containerID="cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059" Jul 23 21:31:57.512783 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512502 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059"} err="failed to get container status \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": rpc error: code = NotFound desc = could not find container \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": container with ID starting with cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059 not found: ID does not exist" Jul 23 21:31:57.512783 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512516 2576 scope.go:117] "RemoveContainer" containerID="47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9" Jul 23 21:31:57.512783 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512777 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9"} err="failed to get container status \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": rpc error: code = NotFound desc = could not find container \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": container with ID starting with 47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9 not found: ID does not exist" Jul 23 21:31:57.512888 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512792 2576 scope.go:117] "RemoveContainer" containerID="41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90" Jul 23 21:31:57.512998 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512984 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90"} err="failed to get container status \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": rpc error: code = NotFound desc = could not find container \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": container with ID starting with 41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90 not found: ID does not exist" Jul 23 21:31:57.513045 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.512998 2576 scope.go:117] "RemoveContainer" containerID="313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29" Jul 23 21:31:57.513242 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.513217 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29"} err="failed to get container status \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": rpc error: code = NotFound desc = could not find container \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": container with ID starting with 313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29 not found: ID does not exist" Jul 23 21:31:57.513242 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.513236 2576 scope.go:117] "RemoveContainer" containerID="03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b" Jul 23 21:31:57.513492 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.513475 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b"} err="failed to get container status \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": rpc error: code = NotFound desc = could not find container \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": container with ID starting with 03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b not found: ID does not exist" Jul 23 21:31:57.513492 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.513490 2576 scope.go:117] "RemoveContainer" containerID="a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec" Jul 23 21:31:57.514316 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.513745 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec"} err="failed to get container status \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": rpc error: code = NotFound desc = could not find container \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": container with ID starting with a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec not found: ID does not exist" Jul 23 21:31:57.514316 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.513766 2576 scope.go:117] "RemoveContainer" containerID="674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd" Jul 23 21:31:57.514316 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.513969 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd"} err="failed to get container status \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": rpc error: code = NotFound desc = could not find container \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": container with ID starting with 674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd not found: ID does not exist" Jul 23 21:31:57.514316 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.513988 2576 scope.go:117] "RemoveContainer" containerID="cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059" Jul 23 21:31:57.514316 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.514243 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059"} err="failed to get container status \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": rpc error: code = NotFound desc = could not find container \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": container with ID starting with cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059 not found: ID does not exist" Jul 23 21:31:57.514316 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.514263 2576 scope.go:117] "RemoveContainer" containerID="47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9" Jul 23 21:31:57.514816 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.514726 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9"} err="failed to get container status \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": rpc error: code = NotFound desc = could not find container \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": container with ID starting with 47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9 not found: ID does not exist" Jul 23 21:31:57.514816 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.514751 2576 scope.go:117] "RemoveContainer" containerID="41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90" Jul 23 21:31:57.515209 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.515123 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90"} err="failed to get container status \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": rpc error: code = NotFound desc = could not find container \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": container with ID starting with 41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90 not found: ID does not exist" Jul 23 21:31:57.515209 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.515148 2576 scope.go:117] "RemoveContainer" containerID="313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29" Jul 23 21:31:57.515584 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.515501 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29"} err="failed to get container status \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": rpc error: code = NotFound desc = could not find container \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": container with ID starting with 313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29 not found: ID does not exist" Jul 23 21:31:57.515584 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.515523 2576 scope.go:117] "RemoveContainer" containerID="03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b" Jul 23 21:31:57.515983 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.515906 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b"} err="failed to get container status \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": rpc error: code = NotFound desc = could not find container \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": container with ID starting with 03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b not found: ID does not exist" Jul 23 21:31:57.515983 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.515927 2576 scope.go:117] "RemoveContainer" containerID="a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec" Jul 23 21:31:57.516304 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.516279 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec"} err="failed to get container status \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": rpc error: code = NotFound desc = could not find container \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": container with ID starting with a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec not found: ID does not exist" Jul 23 21:31:57.516304 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.516303 2576 scope.go:117] "RemoveContainer" containerID="674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd" Jul 23 21:31:57.517046 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.516598 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd"} err="failed to get container status \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": rpc error: code = NotFound desc = could not find container \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": container with ID starting with 674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd not found: ID does not exist" Jul 23 21:31:57.517046 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.516622 2576 scope.go:117] "RemoveContainer" containerID="cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059" Jul 23 21:31:57.517046 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.516908 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059"} err="failed to get container status \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": rpc error: code = NotFound desc = could not find container \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": container with ID starting with cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059 not found: ID does not exist" Jul 23 21:31:57.517046 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.516928 2576 scope.go:117] "RemoveContainer" containerID="47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9" Jul 23 21:31:57.517274 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.517196 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9"} err="failed to get container status \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": rpc error: code = NotFound desc = could not find container \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": container with ID starting with 47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9 not found: ID does not exist" Jul 23 21:31:57.517274 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.517215 2576 scope.go:117] "RemoveContainer" containerID="41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90" Jul 23 21:31:57.517518 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.517499 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90"} err="failed to get container status \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": rpc error: code = NotFound desc = could not find container \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": container with ID starting with 41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90 not found: ID does not exist" Jul 23 21:31:57.517558 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.517519 2576 scope.go:117] "RemoveContainer" containerID="313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29" Jul 23 21:31:57.517869 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.517854 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29"} err="failed to get container status \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": rpc error: code = NotFound desc = could not find container \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": container with ID starting with 313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29 not found: ID does not exist" Jul 23 21:31:57.517869 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.517869 2576 scope.go:117] "RemoveContainer" containerID="03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b" Jul 23 21:31:57.518120 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.518102 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b"} err="failed to get container status \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": rpc error: code = NotFound desc = could not find container \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": container with ID starting with 03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b not found: ID does not exist" Jul 23 21:31:57.518120 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.518119 2576 scope.go:117] "RemoveContainer" containerID="a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec" Jul 23 21:31:57.518342 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.518326 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec"} err="failed to get container status \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": rpc error: code = NotFound desc = could not find container \"a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec\": container with ID starting with a99fecca1a3726358e8700ad7106aeb487e3a6e05ba7f62fa010b398c43df9ec not found: ID does not exist" Jul 23 21:31:57.518396 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.518342 2576 scope.go:117] "RemoveContainer" containerID="674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd" Jul 23 21:31:57.518576 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.518556 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd"} err="failed to get container status \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": rpc error: code = NotFound desc = could not find container \"674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd\": container with ID starting with 674ca8f6b027aa8042173677eb49a6de7ff2f9941ed635c036ff2f9dc2fb18bd not found: ID does not exist" Jul 23 21:31:57.518576 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.518576 2576 scope.go:117] "RemoveContainer" containerID="cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059" Jul 23 21:31:57.518736 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.518715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.518820 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.518803 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059"} err="failed to get container status \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": rpc error: code = NotFound desc = could not find container \"cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059\": container with ID starting with cd074772a7732f652cc324ae7b0d4a3d87211f612da7efd1787fe8ec17f99059 not found: ID does not exist" Jul 23 21:31:57.518864 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.518820 2576 scope.go:117] "RemoveContainer" containerID="47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9" Jul 23 21:31:57.519169 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.519006 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9"} err="failed to get container status \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": rpc error: code = NotFound desc = could not find container \"47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9\": container with ID starting with 47089d57d293efd0b7c994a415f62b6a75206a106b2cf2fc18094304e063a8a9 not found: ID does not exist" Jul 23 21:31:57.519169 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.519028 2576 scope.go:117] "RemoveContainer" containerID="41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90" Jul 23 21:31:57.519333 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.519236 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90"} err="failed to get container status \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": rpc error: code = NotFound desc = could not find container \"41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90\": container with ID starting with 41d38cf98cc2e915d46dfe28de8583361422eec5b7c4508d2dbf17d0403fdb90 not found: ID does not exist" Jul 23 21:31:57.519333 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.519261 2576 scope.go:117] "RemoveContainer" containerID="313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29" Jul 23 21:31:57.519493 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.519476 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29"} err="failed to get container status \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": rpc error: code = NotFound desc = could not find container \"313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29\": container with ID starting with 313f70df3ee714739a3ed4908df01191e79ebfdae12a3c2fac453beb7e6e1c29 not found: ID does not exist" Jul 23 21:31:57.519537 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.519494 2576 scope.go:117] "RemoveContainer" containerID="03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b" Jul 23 21:31:57.519745 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.519723 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b"} err="failed to get container status \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": rpc error: code = NotFound desc = could not find container \"03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b\": container with ID starting with 03ee8aac4d63109eb1afc2134517a28e50c50a4fab215c4f6474c74c533ae70b not found: ID does not exist" Jul 23 21:31:57.521050 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.521035 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 21:31:57.521365 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.521348 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 21:31:57.521441 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.521372 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7sdujg89pmkg5\"" Jul 23 21:31:57.521441 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.521427 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 21:31:57.521555 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.521441 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 21:31:57.521783 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.521728 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-f78wd\"" Jul 23 21:31:57.521783 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.521736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 21:31:57.521783 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.521749 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 21:31:57.521970 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.521830 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 21:31:57.522176 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.522157 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 21:31:57.522283 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.522214 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 21:31:57.522283 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.522233 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 21:31:57.522715 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.522696 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 21:31:57.522797 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.522736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 21:31:57.524602 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.524581 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 21:31:57.527354 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.527335 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 21:31:57.529815 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.529798 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 21:31:57.606456 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.606775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.606775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606483 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.606775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606529 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.606775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.606775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.606775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.606775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.606775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.606775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.606775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.606775 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.607200 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.607200 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgk5v\" (UniqueName: \"kubernetes.io/projected/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-kube-api-access-lgk5v\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.607200 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.607200 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.607200 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606873 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.607200 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.607200 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.606995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.607200 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.607031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-config\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.707992 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.707905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.707992 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.707939 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.707992 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.707957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.707992 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.707978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.708333 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.708007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.708333 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.708031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgk5v\" (UniqueName: \"kubernetes.io/projected/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-kube-api-access-lgk5v\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.708333 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.708167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.708583 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.708554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.708601 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.708687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.708711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.708726 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.708750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-config\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.708772 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.708791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.708997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.709024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.709054 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.709085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.709136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.709161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.709169 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.709169 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.709254 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.709198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.711694 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.711380 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.711812 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.711779 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.712099 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.712074 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.712183 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.712167 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-config\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.712536 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.712269 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.712536 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.712270 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.712811 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.712707 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.713669 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.713144 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.713669 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.713294 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.713669 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.713377 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.713669 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.713625 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.713923 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.713719 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.714493 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.714475 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.714493 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.714483 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.714801 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.714784 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.716467 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.716446 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgk5v\" (UniqueName: \"kubernetes.io/projected/dd094e3b-8102-4c52-9fc6-07ec26b44c6e-kube-api-access-lgk5v\") pod \"prometheus-k8s-0\" (UID: \"dd094e3b-8102-4c52-9fc6-07ec26b44c6e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.829693 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.829657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:31:57.968770 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:57.968694 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 21:31:57.972364 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:31:57.972336 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd094e3b_8102_4c52_9fc6_07ec26b44c6e.slice/crio-fe7fce195fcc4c07e8fe90d350d1dd025b543c96fdb2efc249f32071d71c0954 WatchSource:0}: Error finding container fe7fce195fcc4c07e8fe90d350d1dd025b543c96fdb2efc249f32071d71c0954: Status 404 returned error can't find the container with id fe7fce195fcc4c07e8fe90d350d1dd025b543c96fdb2efc249f32071d71c0954 Jul 23 21:31:58.462932 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:58.462898 2576 generic.go:356] "Generic (PLEG): container finished" podID="dd094e3b-8102-4c52-9fc6-07ec26b44c6e" containerID="e7370bb92118d43a56afdf4c44f8299146c44ba3b8621624e86297d1fb1b27ec" exitCode=0 Jul 23 21:31:58.463093 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:58.462938 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd094e3b-8102-4c52-9fc6-07ec26b44c6e","Type":"ContainerDied","Data":"e7370bb92118d43a56afdf4c44f8299146c44ba3b8621624e86297d1fb1b27ec"} Jul 23 21:31:58.463093 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:58.462988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd094e3b-8102-4c52-9fc6-07ec26b44c6e","Type":"ContainerStarted","Data":"fe7fce195fcc4c07e8fe90d350d1dd025b543c96fdb2efc249f32071d71c0954"} Jul 23 21:31:59.249119 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:59.249082 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b690384c-021c-4301-9d1f-e8bb0e3b4d83" path="/var/lib/kubelet/pods/b690384c-021c-4301-9d1f-e8bb0e3b4d83/volumes" Jul 23 21:31:59.470361 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:59.470329 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd094e3b-8102-4c52-9fc6-07ec26b44c6e","Type":"ContainerStarted","Data":"b6da4e046d8f7ba9504daab6b7768f4f2807707873daac4e5af1ab7afaf15130"} Jul 23 21:31:59.470496 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:59.470391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd094e3b-8102-4c52-9fc6-07ec26b44c6e","Type":"ContainerStarted","Data":"d7796567cf5abb4f5184e529587503b3f4feca9bc07619d283915ff8d717ea99"} Jul 23 21:31:59.470496 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:59.470417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd094e3b-8102-4c52-9fc6-07ec26b44c6e","Type":"ContainerStarted","Data":"1546ce2f8a13a9258a0d2cba48baa903a7573172fcbe476a2807165e0402a8e2"} Jul 23 21:31:59.470496 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:59.470440 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd094e3b-8102-4c52-9fc6-07ec26b44c6e","Type":"ContainerStarted","Data":"781471b0fd3ffe8d2ae719ee9a32d7425c111f07f59d67b6deb493872cb112a9"} Jul 23 21:31:59.470496 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:59.470461 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd094e3b-8102-4c52-9fc6-07ec26b44c6e","Type":"ContainerStarted","Data":"3c32e2041880c1e29ce99e2927d3a4ad2f70e4c214f07b76973f43237a5f5c2f"} Jul 23 21:31:59.470496 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:59.470489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd094e3b-8102-4c52-9fc6-07ec26b44c6e","Type":"ContainerStarted","Data":"2e4af19633a3d86c567e34eb83e9e6ad1a0cf33bc5d65cc0f63dc1ef320080d7"} Jul 23 21:31:59.532525 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:31:59.532479 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.510131324 podStartE2EDuration="2.532460974s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.32965ms" isStatefulPod=false podCreationTimestamp="2026-07-23 21:31:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:31:59.529901632 +0000 UTC m=+352.857590369" watchObservedRunningTime="2026-07-23 21:31:59.532460974 +0000 UTC m=+352.860149691" Jul 23 21:32:00.337749 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:00.337711 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:32:00.438178 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:00.438135 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:32:02.830509 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:02.830473 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:32:03.805258 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:03.805216 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:32:03.903959 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:03.903928 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:32:11.643597 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:11.643560 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:32:11.696764 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:11.696734 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:32:11.764085 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:11.764048 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:32:18.622881 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:18.622850 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:32:38.950922 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:38.950882 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:32:39.000849 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:39.000815 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:32:57.830880 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:57.830827 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:32:57.846677 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:57.846649 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:32:58.704790 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:32:58.704758 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 21:33:06.416927 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:06.416887 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:06.470292 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:06.470259 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:11.573404 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:11.573368 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:11.674242 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:11.674205 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:11.775581 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:11.775551 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:12.320589 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:12.320556 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:18.395626 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:18.395590 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:18.453304 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:18.453273 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:22.929476 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:22.929446 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:23.031047 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:23.031015 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:23.090498 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:23.090466 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:28.085699 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:28.085667 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:28.185810 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:28.185774 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:33:28.526879 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:33:28.526791 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:12.088111 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:12.088072 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:18.863680 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:18.863614 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:18.965417 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:18.965375 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:21.697159 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:21.697129 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:41.294099 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:41.294070 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:42.237619 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:42.237586 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:44.873386 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:44.873355 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:44.965553 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:44.965522 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:45.811788 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:45.811750 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:45.977871 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:45.977838 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:46.880892 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:46.880853 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:46.980045 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:46.980012 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:48.891218 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:48.891184 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:49.284236 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:49.284205 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:51.730364 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:51.730327 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:53.367026 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:53.366980 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:55.224788 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.224753 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x"] Jul 23 21:34:55.227120 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.227105 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x" Jul 23 21:34:55.229837 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.229810 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hxk5h\"" Jul 23 21:34:55.229985 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.229874 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 21:34:55.230720 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.230700 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 21:34:55.240816 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.240795 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x"] Jul 23 21:34:55.378647 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.378593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7wq6\" (UniqueName: \"kubernetes.io/projected/e02319f1-69e9-429e-bcfb-0f6599c054d7-kube-api-access-b7wq6\") pod \"cert-manager-cainjector-559cdd8c87-gqh9x\" (UID: \"e02319f1-69e9-429e-bcfb-0f6599c054d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x" Jul 23 21:34:55.378895 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.378656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e02319f1-69e9-429e-bcfb-0f6599c054d7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gqh9x\" (UID: \"e02319f1-69e9-429e-bcfb-0f6599c054d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x" Jul 23 21:34:55.479585 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.479494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7wq6\" (UniqueName: \"kubernetes.io/projected/e02319f1-69e9-429e-bcfb-0f6599c054d7-kube-api-access-b7wq6\") pod \"cert-manager-cainjector-559cdd8c87-gqh9x\" (UID: \"e02319f1-69e9-429e-bcfb-0f6599c054d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x" Jul 23 21:34:55.479585 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.479538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e02319f1-69e9-429e-bcfb-0f6599c054d7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gqh9x\" (UID: \"e02319f1-69e9-429e-bcfb-0f6599c054d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x" Jul 23 21:34:55.490566 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.490538 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7wq6\" (UniqueName: \"kubernetes.io/projected/e02319f1-69e9-429e-bcfb-0f6599c054d7-kube-api-access-b7wq6\") pod \"cert-manager-cainjector-559cdd8c87-gqh9x\" (UID: \"e02319f1-69e9-429e-bcfb-0f6599c054d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x" Jul 23 21:34:55.490566 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.490547 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e02319f1-69e9-429e-bcfb-0f6599c054d7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gqh9x\" (UID: \"e02319f1-69e9-429e-bcfb-0f6599c054d7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x" Jul 23 21:34:55.542621 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.542591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x" Jul 23 21:34:55.687929 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.687898 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x"] Jul 23 21:34:55.691833 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:34:55.691802 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode02319f1_69e9_429e_bcfb_0f6599c054d7.slice/crio-33b35e4e0d1000b5d99a4ca67f6160a6f6f30b8ffb4a6a26e44aad17c0ab2f2a WatchSource:0}: Error finding container 33b35e4e0d1000b5d99a4ca67f6160a6f6f30b8ffb4a6a26e44aad17c0ab2f2a: Status 404 returned error can't find the container with id 33b35e4e0d1000b5d99a4ca67f6160a6f6f30b8ffb4a6a26e44aad17c0ab2f2a Jul 23 21:34:55.693748 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:55.693732 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 21:34:56.129546 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:56.129511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x" event={"ID":"e02319f1-69e9-429e-bcfb-0f6599c054d7","Type":"ContainerStarted","Data":"33b35e4e0d1000b5d99a4ca67f6160a6f6f30b8ffb4a6a26e44aad17c0ab2f2a"} Jul 23 21:34:57.266912 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:57.266832 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:57.367696 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:57.367666 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:34:57.497907 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:34:57.497873 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:01.154353 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:01.154313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x" event={"ID":"e02319f1-69e9-429e-bcfb-0f6599c054d7","Type":"ContainerStarted","Data":"0e80ee7793f5973358f7c8c50acf51e29561afd1206553bb63c8708a94a2bfd1"} Jul 23 21:35:01.170565 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:01.170516 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gqh9x" podStartSLOduration=1.468966292 podStartE2EDuration="6.170500783s" totalImagesPullingTime="4.701534491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:01.169607363 +0000 UTC m=+534.497296081" watchObservedRunningTime="2026-07-23 21:35:01.170500783 +0000 UTC m=+534.498189502" Jul 23 21:35:01.177451 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:01.177426 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:01.274439 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:01.274404 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:02.951600 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:02.951565 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:03.051577 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:03.051544 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:05.001899 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:05.001867 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:19.464246 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:19.464205 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:19.562572 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:19.562539 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:20.122154 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.122125 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:20.461233 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.461146 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:20.604944 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.604908 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh"] Jul 23 21:35:20.605680 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.605655 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:20.610445 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.610425 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.616170 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.616141 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 21:35:20.616741 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.616722 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 21:35:20.616846 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.616785 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hlkxg\"" Jul 23 21:35:20.616922 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.616788 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 21:35:20.617381 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.617085 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 21:35:20.629562 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.629535 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh"] Jul 23 21:35:20.685770 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.685737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-manifests\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.685770 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.685774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.685943 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.685808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.685943 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.685881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-tmp\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.685943 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.685915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gb5d\" (UniqueName: \"kubernetes.io/projected/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-kube-api-access-8gb5d\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.728661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.728564 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:20.786909 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.786866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-tmp\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.787057 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.786926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gb5d\" (UniqueName: \"kubernetes.io/projected/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-kube-api-access-8gb5d\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.787057 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.786978 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-manifests\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.787057 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.787005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.787057 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.787036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.787376 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.787347 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-manifests\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.789411 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.789391 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-tmp\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.789555 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.789539 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.789602 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.789580 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.801518 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.801490 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gb5d\" (UniqueName: \"kubernetes.io/projected/68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9-kube-api-access-8gb5d\") pod \"opendatahub-operator-controller-manager-75db77d775-cn7xh\" (UID: \"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9\") " pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.847738 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.847711 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:20.921463 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.921437 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:20.927525 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:20.927501 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:21.027705 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:21.027676 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:21.061617 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:21.061595 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh"] Jul 23 21:35:21.064105 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:35:21.064081 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e633f0_c44e_4b65_b7f4_5c91b2d5f8c9.slice/crio-bd7478791b6999864cdd5f74fd3ea7a6a032c6eac29f5b4fcb2d83a2441dc563 WatchSource:0}: Error finding container bd7478791b6999864cdd5f74fd3ea7a6a032c6eac29f5b4fcb2d83a2441dc563: Status 404 returned error can't find the container with id bd7478791b6999864cdd5f74fd3ea7a6a032c6eac29f5b4fcb2d83a2441dc563 Jul 23 21:35:21.128460 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:21.128430 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:21.229710 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:21.229667 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:21.233088 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:21.233061 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" event={"ID":"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9","Type":"ContainerStarted","Data":"bd7478791b6999864cdd5f74fd3ea7a6a032c6eac29f5b4fcb2d83a2441dc563"} Jul 23 21:35:24.248864 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:24.248831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" event={"ID":"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9","Type":"ContainerStarted","Data":"36ea7b06f85f023e2b1cb414234930fb35d27a97e58716e27acbbe9119cc0e3f"} Jul 23 21:35:25.254894 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:25.254850 2576 generic.go:356] "Generic (PLEG): container finished" podID="68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9" containerID="36ea7b06f85f023e2b1cb414234930fb35d27a97e58716e27acbbe9119cc0e3f" exitCode=0 Jul 23 21:35:25.255310 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:25.254933 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" event={"ID":"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9","Type":"ContainerDied","Data":"36ea7b06f85f023e2b1cb414234930fb35d27a97e58716e27acbbe9119cc0e3f"} Jul 23 21:35:26.261109 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:26.261072 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" event={"ID":"68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9","Type":"ContainerStarted","Data":"7776b9bf8c9d479878c867bc43b5e0e49415d533d399c10120e8a2028a248474"} Jul 23 21:35:26.261578 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:26.261196 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:26.283336 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:26.283289 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" podStartSLOduration=1.700681315 podStartE2EDuration="6.283276548s" totalImagesPullingTime="3.492436899s" totalInitContainerRuntime="1.090158334s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:26.282160197 +0000 UTC m=+559.609848927" watchObservedRunningTime="2026-07-23 21:35:26.283276548 +0000 UTC m=+559.610965273" Jul 23 21:35:37.185811 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:37.185779 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:37.266932 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:37.266905 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75db77d775-cn7xh" Jul 23 21:35:37.289898 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:37.289870 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:37.613614 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:37.613577 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:38.322916 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.322875 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:38.411157 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.411119 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:38.421461 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.421431 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb"] Jul 23 21:35:38.428889 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.428867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.432765 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.432745 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 23 21:35:38.432892 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.432763 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 23 21:35:38.432892 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.432777 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 23 21:35:38.432892 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.432745 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 23 21:35:38.432892 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.432749 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hbfs9\"" Jul 23 21:35:38.432892 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.432745 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 23 21:35:38.452843 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.452622 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb"] Jul 23 21:35:38.547496 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.547463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ac38004-6e58-41d8-a6a7-d085f9bddb29-metrics-cert\") pod \"lws-controller-manager-746c6b6887-7dqsb\" (UID: \"4ac38004-6e58-41d8-a6a7-d085f9bddb29\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.547715 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.547508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ac38004-6e58-41d8-a6a7-d085f9bddb29-manager-config\") pod \"lws-controller-manager-746c6b6887-7dqsb\" (UID: \"4ac38004-6e58-41d8-a6a7-d085f9bddb29\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.547715 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.547543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ac38004-6e58-41d8-a6a7-d085f9bddb29-cert\") pod \"lws-controller-manager-746c6b6887-7dqsb\" (UID: \"4ac38004-6e58-41d8-a6a7-d085f9bddb29\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.547715 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.547608 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2xlz\" (UniqueName: \"kubernetes.io/projected/4ac38004-6e58-41d8-a6a7-d085f9bddb29-kube-api-access-f2xlz\") pod \"lws-controller-manager-746c6b6887-7dqsb\" (UID: \"4ac38004-6e58-41d8-a6a7-d085f9bddb29\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.648380 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.648289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2xlz\" (UniqueName: \"kubernetes.io/projected/4ac38004-6e58-41d8-a6a7-d085f9bddb29-kube-api-access-f2xlz\") pod \"lws-controller-manager-746c6b6887-7dqsb\" (UID: \"4ac38004-6e58-41d8-a6a7-d085f9bddb29\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.648380 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.648344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ac38004-6e58-41d8-a6a7-d085f9bddb29-metrics-cert\") pod \"lws-controller-manager-746c6b6887-7dqsb\" (UID: \"4ac38004-6e58-41d8-a6a7-d085f9bddb29\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.648380 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.648369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ac38004-6e58-41d8-a6a7-d085f9bddb29-manager-config\") pod \"lws-controller-manager-746c6b6887-7dqsb\" (UID: \"4ac38004-6e58-41d8-a6a7-d085f9bddb29\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.648676 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.648397 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ac38004-6e58-41d8-a6a7-d085f9bddb29-cert\") pod \"lws-controller-manager-746c6b6887-7dqsb\" (UID: \"4ac38004-6e58-41d8-a6a7-d085f9bddb29\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.649120 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.649096 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4ac38004-6e58-41d8-a6a7-d085f9bddb29-manager-config\") pod \"lws-controller-manager-746c6b6887-7dqsb\" (UID: \"4ac38004-6e58-41d8-a6a7-d085f9bddb29\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.650993 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.650962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4ac38004-6e58-41d8-a6a7-d085f9bddb29-metrics-cert\") pod \"lws-controller-manager-746c6b6887-7dqsb\" (UID: \"4ac38004-6e58-41d8-a6a7-d085f9bddb29\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.650993 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.650987 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ac38004-6e58-41d8-a6a7-d085f9bddb29-cert\") pod \"lws-controller-manager-746c6b6887-7dqsb\" (UID: \"4ac38004-6e58-41d8-a6a7-d085f9bddb29\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.656155 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.656135 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2xlz\" (UniqueName: \"kubernetes.io/projected/4ac38004-6e58-41d8-a6a7-d085f9bddb29-kube-api-access-f2xlz\") pod \"lws-controller-manager-746c6b6887-7dqsb\" (UID: \"4ac38004-6e58-41d8-a6a7-d085f9bddb29\") " pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.738483 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.738446 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:38.883292 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:38.883258 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb"] Jul 23 21:35:38.886318 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:35:38.886291 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac38004_6e58_41d8_a6a7_d085f9bddb29.slice/crio-c5b6bc5cf79f6519deb67c720c4fac2e4905368e4951818d8616522802e305e3 WatchSource:0}: Error finding container c5b6bc5cf79f6519deb67c720c4fac2e4905368e4951818d8616522802e305e3: Status 404 returned error can't find the container with id c5b6bc5cf79f6519deb67c720c4fac2e4905368e4951818d8616522802e305e3 Jul 23 21:35:39.316575 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:39.316537 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" event={"ID":"4ac38004-6e58-41d8-a6a7-d085f9bddb29","Type":"ContainerStarted","Data":"c5b6bc5cf79f6519deb67c720c4fac2e4905368e4951818d8616522802e305e3"} Jul 23 21:35:40.117252 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:40.117221 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:40.277287 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:40.277249 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:40.791276 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:40.791244 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:40.899294 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:40.899261 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k"] Jul 23 21:35:40.908947 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:40.908921 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" Jul 23 21:35:40.911507 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:40.911478 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 23 21:35:40.911803 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:40.911786 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 21:35:40.912025 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:40.912011 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 23 21:35:40.912835 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:40.912819 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wpt8w\"" Jul 23 21:35:40.912928 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:40.912861 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 21:35:40.927217 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:40.927191 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k"] Jul 23 21:35:41.070003 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.069908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d88982d-42d0-4d4a-ae18-3d27cdb08aab-tmp\") pod \"kube-auth-proxy-5b88774c5c-86g5k\" (UID: \"1d88982d-42d0-4d4a-ae18-3d27cdb08aab\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" Jul 23 21:35:41.070003 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.069989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d88982d-42d0-4d4a-ae18-3d27cdb08aab-tls-certs\") pod \"kube-auth-proxy-5b88774c5c-86g5k\" (UID: \"1d88982d-42d0-4d4a-ae18-3d27cdb08aab\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" Jul 23 21:35:41.070206 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.070070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45tks\" (UniqueName: \"kubernetes.io/projected/1d88982d-42d0-4d4a-ae18-3d27cdb08aab-kube-api-access-45tks\") pod \"kube-auth-proxy-5b88774c5c-86g5k\" (UID: \"1d88982d-42d0-4d4a-ae18-3d27cdb08aab\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" Jul 23 21:35:41.070708 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.070680 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:41.171609 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.171567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d88982d-42d0-4d4a-ae18-3d27cdb08aab-tls-certs\") pod \"kube-auth-proxy-5b88774c5c-86g5k\" (UID: \"1d88982d-42d0-4d4a-ae18-3d27cdb08aab\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" Jul 23 21:35:41.172064 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.171674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45tks\" (UniqueName: \"kubernetes.io/projected/1d88982d-42d0-4d4a-ae18-3d27cdb08aab-kube-api-access-45tks\") pod \"kube-auth-proxy-5b88774c5c-86g5k\" (UID: \"1d88982d-42d0-4d4a-ae18-3d27cdb08aab\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" Jul 23 21:35:41.172064 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.171721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d88982d-42d0-4d4a-ae18-3d27cdb08aab-tmp\") pod \"kube-auth-proxy-5b88774c5c-86g5k\" (UID: \"1d88982d-42d0-4d4a-ae18-3d27cdb08aab\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" Jul 23 21:35:41.175345 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.175315 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d88982d-42d0-4d4a-ae18-3d27cdb08aab-tmp\") pod \"kube-auth-proxy-5b88774c5c-86g5k\" (UID: \"1d88982d-42d0-4d4a-ae18-3d27cdb08aab\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" Jul 23 21:35:41.175495 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.175460 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d88982d-42d0-4d4a-ae18-3d27cdb08aab-tls-certs\") pod \"kube-auth-proxy-5b88774c5c-86g5k\" (UID: \"1d88982d-42d0-4d4a-ae18-3d27cdb08aab\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" Jul 23 21:35:41.183080 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.183053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45tks\" (UniqueName: \"kubernetes.io/projected/1d88982d-42d0-4d4a-ae18-3d27cdb08aab-kube-api-access-45tks\") pod \"kube-auth-proxy-5b88774c5c-86g5k\" (UID: \"1d88982d-42d0-4d4a-ae18-3d27cdb08aab\") " pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" Jul 23 21:35:41.190140 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.190110 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:41.220328 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.220290 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" Jul 23 21:35:41.283565 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.283519 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:41.568693 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:41.568558 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k"] Jul 23 21:35:41.571261 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:35:41.571222 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d88982d_42d0_4d4a_ae18_3d27cdb08aab.slice/crio-7a61b8408701d7116240a4bc53e00195f590206509bee7031bb337c9befd22be WatchSource:0}: Error finding container 7a61b8408701d7116240a4bc53e00195f590206509bee7031bb337c9befd22be: Status 404 returned error can't find the container with id 7a61b8408701d7116240a4bc53e00195f590206509bee7031bb337c9befd22be Jul 23 21:35:42.084959 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:42.084920 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:42.331920 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:42.331885 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:42.334026 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:42.333993 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" event={"ID":"4ac38004-6e58-41d8-a6a7-d085f9bddb29","Type":"ContainerStarted","Data":"76e59b4dc89cbfdd59db49a877dbcf6fc486168ce82e8531b704aac1ccca5958"} Jul 23 21:35:42.334244 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:42.334158 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:42.335248 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:42.335178 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" event={"ID":"1d88982d-42d0-4d4a-ae18-3d27cdb08aab","Type":"ContainerStarted","Data":"7a61b8408701d7116240a4bc53e00195f590206509bee7031bb337c9befd22be"} Jul 23 21:35:42.364055 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:42.364006 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" podStartSLOduration=1.753528835 podStartE2EDuration="4.363988475s" totalImagesPullingTime="2.61045964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:42.361994336 +0000 UTC m=+575.689683077" watchObservedRunningTime="2026-07-23 21:35:42.363988475 +0000 UTC m=+575.691677257" Jul 23 21:35:42.404365 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:42.404324 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:42.528434 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:42.528399 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:43.363403 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:43.363366 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:44.346078 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:44.346044 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" event={"ID":"1d88982d-42d0-4d4a-ae18-3d27cdb08aab","Type":"ContainerStarted","Data":"4927678c21c4a222bfb743616004801e02403036ad2ad12031942f6d25a210bd"} Jul 23 21:35:44.363238 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:44.363186 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b88774c5c-86g5k" podStartSLOduration=1.78179628 podStartE2EDuration="4.363169704s" totalImagesPullingTime="2.581373424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:35:44.36158432 +0000 UTC m=+577.689273058" watchObservedRunningTime="2026-07-23 21:35:44.363169704 +0000 UTC m=+577.690858421" Jul 23 21:35:47.961381 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:47.961343 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:48.243079 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:48.243002 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:48.547710 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:48.547673 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:48.647410 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:48.647375 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:52.509162 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:52.509130 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:52.605249 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:52.605222 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:52.822204 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:52.822172 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:52.954851 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:52.954821 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:53.056616 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:53.056584 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:53.129327 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:53.129242 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:53.196760 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:53.196729 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:53.342769 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:53.342742 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-746c6b6887-7dqsb" Jul 23 21:35:56.245017 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:56.244980 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:35:56.352512 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:35:56.352473 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:36:07.124600 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:36:07.124571 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5j52_01dab5b8-48b4-4745-8526-c822fa9110a2/ovn-acl-logging/0.log" Jul 23 21:36:07.124600 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:36:07.124585 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5j52_01dab5b8-48b4-4745-8526-c822fa9110a2/ovn-acl-logging/0.log" Jul 23 21:36:27.181890 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:36:27.181807 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:36:41.863068 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:36:41.863020 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:36:42.067797 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:36:42.067764 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:36:42.261623 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:36:42.261522 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:36:42.824925 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:36:42.824896 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:36:43.028931 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:36:43.028886 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:07.320401 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:07.320372 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:07.496955 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:07.496925 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:07.559821 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:07.559789 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:08.060163 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:08.060130 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:08.161569 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:08.161535 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:10.925188 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:10.925153 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:11.539720 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:11.539683 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:16.348388 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:16.348350 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:18.209515 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:18.209476 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:18.309257 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:18.309207 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:18.412096 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:18.412057 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:18.513316 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:18.513237 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:19.332485 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:19.332435 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:20.173078 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:20.173042 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:22.346959 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:22.346925 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:22.904933 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:22.904902 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:25.983346 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:25.983296 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:28.007083 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:28.007051 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:28.247866 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:28.247834 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:28.353650 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:28.353610 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:28.453764 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:28.453730 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:31.765069 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:31.765034 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:31.866320 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:31.866240 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:33.213559 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:33.213515 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:33.279477 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:33.279444 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:34.592147 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.592110 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb"] Jul 23 21:37:34.594667 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.594626 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" Jul 23 21:37:34.597487 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.597465 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 23 21:37:34.597878 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.597861 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-846n7\"" Jul 23 21:37:34.597965 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.597880 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 21:37:34.598492 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.598478 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 23 21:37:34.598543 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.598491 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 21:37:34.602623 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.602603 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb"] Jul 23 21:37:34.608969 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.608949 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:34.648496 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.648465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wln84\" (UniqueName: \"kubernetes.io/projected/eda5634b-5f05-408e-8d82-86ac2e0fdf6b-kube-api-access-wln84\") pod \"kuadrant-console-plugin-66b5774985-6k9sb\" (UID: \"eda5634b-5f05-408e-8d82-86ac2e0fdf6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" Jul 23 21:37:34.648656 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.648506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eda5634b-5f05-408e-8d82-86ac2e0fdf6b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6k9sb\" (UID: \"eda5634b-5f05-408e-8d82-86ac2e0fdf6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" Jul 23 21:37:34.648656 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.648576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eda5634b-5f05-408e-8d82-86ac2e0fdf6b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6k9sb\" (UID: \"eda5634b-5f05-408e-8d82-86ac2e0fdf6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" Jul 23 21:37:34.749466 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.749434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eda5634b-5f05-408e-8d82-86ac2e0fdf6b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6k9sb\" (UID: \"eda5634b-5f05-408e-8d82-86ac2e0fdf6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" Jul 23 21:37:34.749611 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.749508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wln84\" (UniqueName: \"kubernetes.io/projected/eda5634b-5f05-408e-8d82-86ac2e0fdf6b-kube-api-access-wln84\") pod \"kuadrant-console-plugin-66b5774985-6k9sb\" (UID: \"eda5634b-5f05-408e-8d82-86ac2e0fdf6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" Jul 23 21:37:34.749611 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.749552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eda5634b-5f05-408e-8d82-86ac2e0fdf6b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6k9sb\" (UID: \"eda5634b-5f05-408e-8d82-86ac2e0fdf6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" Jul 23 21:37:34.749611 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:37:34.749584 2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 23 21:37:34.749756 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:37:34.749683 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eda5634b-5f05-408e-8d82-86ac2e0fdf6b-plugin-serving-cert podName:eda5634b-5f05-408e-8d82-86ac2e0fdf6b nodeName:}" failed. No retries permitted until 2026-07-23 21:37:35.249661643 +0000 UTC m=+688.577350369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/eda5634b-5f05-408e-8d82-86ac2e0fdf6b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-6k9sb" (UID: "eda5634b-5f05-408e-8d82-86ac2e0fdf6b") : secret "plugin-serving-cert" not found Jul 23 21:37:34.750290 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.750272 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eda5634b-5f05-408e-8d82-86ac2e0fdf6b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6k9sb\" (UID: \"eda5634b-5f05-408e-8d82-86ac2e0fdf6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" Jul 23 21:37:34.760146 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.760115 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wln84\" (UniqueName: \"kubernetes.io/projected/eda5634b-5f05-408e-8d82-86ac2e0fdf6b-kube-api-access-wln84\") pod \"kuadrant-console-plugin-66b5774985-6k9sb\" (UID: \"eda5634b-5f05-408e-8d82-86ac2e0fdf6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" Jul 23 21:37:34.805664 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:34.805626 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:35.253550 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:35.253513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eda5634b-5f05-408e-8d82-86ac2e0fdf6b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6k9sb\" (UID: \"eda5634b-5f05-408e-8d82-86ac2e0fdf6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" Jul 23 21:37:35.256177 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:35.256153 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eda5634b-5f05-408e-8d82-86ac2e0fdf6b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6k9sb\" (UID: \"eda5634b-5f05-408e-8d82-86ac2e0fdf6b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" Jul 23 21:37:35.504271 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:35.504195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" Jul 23 21:37:35.553508 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:35.553288 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:35.640269 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:35.640243 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb"] Jul 23 21:37:35.642110 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:35.642084 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:35.642819 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:37:35.642792 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeda5634b_5f05_408e_8d82_86ac2e0fdf6b.slice/crio-ae4bb2b715cb0bef45baf3d2b6bb251297b51749bc9551def39d022f91660dfa WatchSource:0}: Error finding container ae4bb2b715cb0bef45baf3d2b6bb251297b51749bc9551def39d022f91660dfa: Status 404 returned error can't find the container with id ae4bb2b715cb0bef45baf3d2b6bb251297b51749bc9551def39d022f91660dfa Jul 23 21:37:35.811896 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:35.811866 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" event={"ID":"eda5634b-5f05-408e-8d82-86ac2e0fdf6b","Type":"ContainerStarted","Data":"ae4bb2b715cb0bef45baf3d2b6bb251297b51749bc9551def39d022f91660dfa"} Jul 23 21:37:39.095724 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:39.095685 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:39.195700 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:39.195662 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:45.747383 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:45.747345 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv"] Jul 23 21:37:45.775647 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:45.769542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" Jul 23 21:37:45.782152 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:45.782125 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jbq99\"" Jul 23 21:37:45.784819 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:45.784788 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv"] Jul 23 21:37:45.856361 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:45.856320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f681ce4-dd27-4767-858d-19d141970323-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5s2hv\" (UID: \"9f681ce4-dd27-4767-858d-19d141970323\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" Jul 23 21:37:45.856556 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:45.856461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4v4h\" (UniqueName: \"kubernetes.io/projected/9f681ce4-dd27-4767-858d-19d141970323-kube-api-access-v4v4h\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5s2hv\" (UID: \"9f681ce4-dd27-4767-858d-19d141970323\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" Jul 23 21:37:45.957445 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:45.957405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4v4h\" (UniqueName: \"kubernetes.io/projected/9f681ce4-dd27-4767-858d-19d141970323-kube-api-access-v4v4h\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5s2hv\" (UID: \"9f681ce4-dd27-4767-858d-19d141970323\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" Jul 23 21:37:45.957660 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:45.957475 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f681ce4-dd27-4767-858d-19d141970323-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5s2hv\" (UID: \"9f681ce4-dd27-4767-858d-19d141970323\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" Jul 23 21:37:45.957939 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:45.957904 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f681ce4-dd27-4767-858d-19d141970323-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5s2hv\" (UID: \"9f681ce4-dd27-4767-858d-19d141970323\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" Jul 23 21:37:45.966064 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:45.966034 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4v4h\" (UniqueName: \"kubernetes.io/projected/9f681ce4-dd27-4767-858d-19d141970323-kube-api-access-v4v4h\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5s2hv\" (UID: \"9f681ce4-dd27-4767-858d-19d141970323\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" Jul 23 21:37:46.092894 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:46.092851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" Jul 23 21:37:47.136913 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:47.136867 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:47.235412 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:47.235373 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:47.730334 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:47.730302 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:47.832195 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:47.832131 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:50.716374 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:50.716333 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:50.775501 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:50.775471 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:55.343034 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:55.342984 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:55.443896 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:55.443840 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:58.256825 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:58.256800 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv"] Jul 23 21:37:58.258989 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:37:58.258960 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f681ce4_dd27_4767_858d_19d141970323.slice/crio-88ccb14f8091ae9ee3e97c7fbe568111963150506c8f1454600aa1c621fd377c WatchSource:0}: Error finding container 88ccb14f8091ae9ee3e97c7fbe568111963150506c8f1454600aa1c621fd377c: Status 404 returned error can't find the container with id 88ccb14f8091ae9ee3e97c7fbe568111963150506c8f1454600aa1c621fd377c Jul 23 21:37:58.927399 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:58.927362 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" event={"ID":"eda5634b-5f05-408e-8d82-86ac2e0fdf6b","Type":"ContainerStarted","Data":"a6a2fdaf23c7f872781c5df4585f37e4febc32367fd133f9e242fe1a9325b422"} Jul 23 21:37:58.928649 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:58.928601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" event={"ID":"9f681ce4-dd27-4767-858d-19d141970323","Type":"ContainerStarted","Data":"88ccb14f8091ae9ee3e97c7fbe568111963150506c8f1454600aa1c621fd377c"} Jul 23 21:37:58.928847 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:58.928826 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:37:58.944166 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:58.944120 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6k9sb" podStartSLOduration=2.106132774 podStartE2EDuration="24.944107989s" totalImagesPullingTime="22.837975215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:37:58.944026224 +0000 UTC m=+712.271714942" watchObservedRunningTime="2026-07-23 21:37:58.944107989 +0000 UTC m=+712.271796710" Jul 23 21:37:59.043202 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:37:59.043175 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:38:03.954451 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:03.954372 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" event={"ID":"9f681ce4-dd27-4767-858d-19d141970323","Type":"ContainerStarted","Data":"da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8"} Jul 23 21:38:03.954922 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:03.954525 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" Jul 23 21:38:03.975316 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:03.975266 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" podStartSLOduration=13.670597257 podStartE2EDuration="18.975248073s" totalImagesPullingTime="5.304650816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:38:03.973480146 +0000 UTC m=+717.301168884" watchObservedRunningTime="2026-07-23 21:38:03.975248073 +0000 UTC m=+717.302936788" Jul 23 21:38:14.960825 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:14.960792 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" Jul 23 21:38:15.036852 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:15.036821 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:38:15.132782 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:15.132745 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:38:27.174695 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:27.174653 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv"] Jul 23 21:38:27.175201 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:27.174922 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" podUID="9f681ce4-dd27-4767-858d-19d141970323" containerName="manager" containerID="cri-o://da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8" gracePeriod=10 Jul 23 21:38:27.468476 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:27.468444 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" Jul 23 21:38:27.519120 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:27.519088 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4v4h\" (UniqueName: \"kubernetes.io/projected/9f681ce4-dd27-4767-858d-19d141970323-kube-api-access-v4v4h\") pod \"9f681ce4-dd27-4767-858d-19d141970323\" (UID: \"9f681ce4-dd27-4767-858d-19d141970323\") " Jul 23 21:38:27.519120 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:27.519127 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f681ce4-dd27-4767-858d-19d141970323-extensions-socket-volume\") pod \"9f681ce4-dd27-4767-858d-19d141970323\" (UID: \"9f681ce4-dd27-4767-858d-19d141970323\") " Jul 23 21:38:27.519571 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:27.519534 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f681ce4-dd27-4767-858d-19d141970323-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9f681ce4-dd27-4767-858d-19d141970323" (UID: "9f681ce4-dd27-4767-858d-19d141970323"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 21:38:27.521571 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:27.521546 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f681ce4-dd27-4767-858d-19d141970323-kube-api-access-v4v4h" (OuterVolumeSpecName: "kube-api-access-v4v4h") pod "9f681ce4-dd27-4767-858d-19d141970323" (UID: "9f681ce4-dd27-4767-858d-19d141970323"). InnerVolumeSpecName "kube-api-access-v4v4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:38:27.620096 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:27.620055 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4v4h\" (UniqueName: \"kubernetes.io/projected/9f681ce4-dd27-4767-858d-19d141970323-kube-api-access-v4v4h\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:38:27.620096 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:27.620087 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f681ce4-dd27-4767-858d-19d141970323-extensions-socket-volume\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:38:28.058180 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:28.058142 2576 generic.go:356] "Generic (PLEG): container finished" podID="9f681ce4-dd27-4767-858d-19d141970323" containerID="da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8" exitCode=0 Jul 23 21:38:28.058370 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:28.058204 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" Jul 23 21:38:28.058370 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:28.058230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" event={"ID":"9f681ce4-dd27-4767-858d-19d141970323","Type":"ContainerDied","Data":"da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8"} Jul 23 21:38:28.058370 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:28.058287 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv" event={"ID":"9f681ce4-dd27-4767-858d-19d141970323","Type":"ContainerDied","Data":"88ccb14f8091ae9ee3e97c7fbe568111963150506c8f1454600aa1c621fd377c"} Jul 23 21:38:28.058370 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:28.058308 2576 scope.go:117] "RemoveContainer" containerID="da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8" Jul 23 21:38:28.067290 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:28.067273 2576 scope.go:117] "RemoveContainer" containerID="da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8" Jul 23 21:38:28.067570 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:38:28.067552 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8\": container with ID starting with da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8 not found: ID does not exist" containerID="da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8" Jul 23 21:38:28.067688 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:28.067578 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8"} err="failed to get container status \"da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8\": rpc error: code = NotFound desc = could not find container \"da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8\": container with ID starting with da3cd4e84d53b9d34ca2de03e89de6e5afea10f668f9d809c7bc686ad60c9cc8 not found: ID does not exist" Jul 23 21:38:28.081788 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:28.081762 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv"] Jul 23 21:38:28.085655 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:28.085618 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5s2hv"] Jul 23 21:38:29.250188 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:29.250151 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f681ce4-dd27-4767-858d-19d141970323" path="/var/lib/kubelet/pods/9f681ce4-dd27-4767-858d-19d141970323/volumes" Jul 23 21:38:31.464498 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.464467 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm"] Jul 23 21:38:31.464868 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.464788 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f681ce4-dd27-4767-858d-19d141970323" containerName="manager" Jul 23 21:38:31.464868 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.464798 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f681ce4-dd27-4767-858d-19d141970323" containerName="manager" Jul 23 21:38:31.464956 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.464876 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f681ce4-dd27-4767-858d-19d141970323" containerName="manager" Jul 23 21:38:31.469506 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.469490 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.471831 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.471809 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 23 21:38:31.471962 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.471872 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kxvg4\"" Jul 23 21:38:31.479971 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.479948 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm"] Jul 23 21:38:31.497984 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.497945 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:38:31.556471 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.556440 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.556673 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.556484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16ee5216-5b61-441f-8777-2d26512f9f3c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.556673 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.556506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.556673 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.556654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ee5216-5b61-441f-8777-2d26512f9f3c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.556811 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.556683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16ee5216-5b61-441f-8777-2d26512f9f3c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.556811 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.556702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftzqk\" (UniqueName: \"kubernetes.io/projected/16ee5216-5b61-441f-8777-2d26512f9f3c-kube-api-access-ftzqk\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.556811 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.556732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.556811 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.556772 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.556939 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.556814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.657706 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.657671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.657706 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.657717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.657939 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.657747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.657939 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.657774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.657939 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.657815 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16ee5216-5b61-441f-8777-2d26512f9f3c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.657939 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.657835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.657939 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.657876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ee5216-5b61-441f-8777-2d26512f9f3c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.657939 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.657900 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16ee5216-5b61-441f-8777-2d26512f9f3c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.657939 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.657925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftzqk\" (UniqueName: \"kubernetes.io/projected/16ee5216-5b61-441f-8777-2d26512f9f3c-kube-api-access-ftzqk\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.658301 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.658150 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.658301 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.658206 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.658415 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.658340 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.658519 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.658500 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.658785 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.658762 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16ee5216-5b61-441f-8777-2d26512f9f3c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.660246 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.660231 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16ee5216-5b61-441f-8777-2d26512f9f3c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.660340 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.660324 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16ee5216-5b61-441f-8777-2d26512f9f3c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.665999 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.665974 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16ee5216-5b61-441f-8777-2d26512f9f3c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.666121 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.666105 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftzqk\" (UniqueName: \"kubernetes.io/projected/16ee5216-5b61-441f-8777-2d26512f9f3c-kube-api-access-ftzqk\") pod \"maas-default-gateway-openshift-default-56654dcf7-gq6bm\" (UID: \"16ee5216-5b61-441f-8777-2d26512f9f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.780268 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.780184 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:31.816385 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.816350 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:38:31.915283 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:31.915254 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm"] Jul 23 21:38:31.917372 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:38:31.917339 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ee5216_5b61_441f_8777_2d26512f9f3c.slice/crio-5524c93888d9c40cea1e0173ae7dba55076e234c3ba238a135ff490a6c646ace WatchSource:0}: Error finding container 5524c93888d9c40cea1e0173ae7dba55076e234c3ba238a135ff490a6c646ace: Status 404 returned error can't find the container with id 5524c93888d9c40cea1e0173ae7dba55076e234c3ba238a135ff490a6c646ace Jul 23 21:38:32.076544 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:32.076509 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" event={"ID":"16ee5216-5b61-441f-8777-2d26512f9f3c","Type":"ContainerStarted","Data":"5524c93888d9c40cea1e0173ae7dba55076e234c3ba238a135ff490a6c646ace"} Jul 23 21:38:34.499204 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:34.499160 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 23 21:38:34.499555 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:34.499240 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 23 21:38:34.499555 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:34.499270 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 23 21:38:35.097819 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:35.097784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" event={"ID":"16ee5216-5b61-441f-8777-2d26512f9f3c","Type":"ContainerStarted","Data":"a0984bcee138a5dda6192e4efce93e76bea0ced8da7277aef8337514bb464cfd"} Jul 23 21:38:35.124431 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:35.124376 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" podStartSLOduration=1.544756958 podStartE2EDuration="4.12435921s" totalImagesPullingTime="2.579602252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:38:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:38:35.122688371 +0000 UTC m=+748.450377116" watchObservedRunningTime="2026-07-23 21:38:35.12435921 +0000 UTC m=+748.452047928" Jul 23 21:38:35.780906 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:35.780860 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:35.785805 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:35.785778 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:36.102619 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:36.102589 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:36.103612 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:36.103594 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-gq6bm" Jul 23 21:38:36.118821 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:36.118770 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:38:36.226969 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:36.226940 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:38:36.279180 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:36.279147 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:38:36.916397 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:36.916367 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-qgrj7"] Jul 23 21:38:36.920560 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:36.920539 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qgrj7" Jul 23 21:38:36.922785 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:36.922765 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xq6sh\"" Jul 23 21:38:36.926118 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:36.926098 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qgrj7"] Jul 23 21:38:36.959602 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:36.959568 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:38:37.005003 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.004969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbtrm\" (UniqueName: \"kubernetes.io/projected/195e9eee-0482-4327-9e7b-2a5fcd592c4e-kube-api-access-lbtrm\") pod \"authorino-58cd955675-qgrj7\" (UID: \"195e9eee-0482-4327-9e7b-2a5fcd592c4e\") " pod="kuadrant-system/authorino-58cd955675-qgrj7" Jul 23 21:38:37.019088 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.019056 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:38:37.105463 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.105427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbtrm\" (UniqueName: \"kubernetes.io/projected/195e9eee-0482-4327-9e7b-2a5fcd592c4e-kube-api-access-lbtrm\") pod \"authorino-58cd955675-qgrj7\" (UID: \"195e9eee-0482-4327-9e7b-2a5fcd592c4e\") " pod="kuadrant-system/authorino-58cd955675-qgrj7" Jul 23 21:38:37.113067 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.113043 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbtrm\" (UniqueName: \"kubernetes.io/projected/195e9eee-0482-4327-9e7b-2a5fcd592c4e-kube-api-access-lbtrm\") pod \"authorino-58cd955675-qgrj7\" (UID: \"195e9eee-0482-4327-9e7b-2a5fcd592c4e\") " pod="kuadrant-system/authorino-58cd955675-qgrj7" Jul 23 21:38:37.130424 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.130392 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-przpb"] Jul 23 21:38:37.132720 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.132698 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-przpb" Jul 23 21:38:37.140812 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.140791 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-przpb"] Jul 23 21:38:37.205949 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.205869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8jkh\" (UniqueName: \"kubernetes.io/projected/c9483f8c-93a6-4d98-bc0f-99cdc7055973-kube-api-access-c8jkh\") pod \"authorino-75d556bd77-przpb\" (UID: \"c9483f8c-93a6-4d98-bc0f-99cdc7055973\") " pod="kuadrant-system/authorino-75d556bd77-przpb" Jul 23 21:38:37.230730 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.230702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qgrj7" Jul 23 21:38:37.306710 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.306678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8jkh\" (UniqueName: \"kubernetes.io/projected/c9483f8c-93a6-4d98-bc0f-99cdc7055973-kube-api-access-c8jkh\") pod \"authorino-75d556bd77-przpb\" (UID: \"c9483f8c-93a6-4d98-bc0f-99cdc7055973\") " pod="kuadrant-system/authorino-75d556bd77-przpb" Jul 23 21:38:37.315350 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.315324 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8jkh\" (UniqueName: \"kubernetes.io/projected/c9483f8c-93a6-4d98-bc0f-99cdc7055973-kube-api-access-c8jkh\") pod \"authorino-75d556bd77-przpb\" (UID: \"c9483f8c-93a6-4d98-bc0f-99cdc7055973\") " pod="kuadrant-system/authorino-75d556bd77-przpb" Jul 23 21:38:37.365510 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.365488 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qgrj7"] Jul 23 21:38:37.367544 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:38:37.367516 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod195e9eee_0482_4327_9e7b_2a5fcd592c4e.slice/crio-82e6021d4d0e3b0ffe5b8ca05ca8a9af9deedcb8b0bf1832cbdd257df4f57ebd WatchSource:0}: Error finding container 82e6021d4d0e3b0ffe5b8ca05ca8a9af9deedcb8b0bf1832cbdd257df4f57ebd: Status 404 returned error can't find the container with id 82e6021d4d0e3b0ffe5b8ca05ca8a9af9deedcb8b0bf1832cbdd257df4f57ebd Jul 23 21:38:37.442660 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.442610 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-przpb" Jul 23 21:38:37.568125 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:37.568100 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-przpb"] Jul 23 21:38:37.570383 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:38:37.570353 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9483f8c_93a6_4d98_bc0f_99cdc7055973.slice/crio-210cd666780dad27d73bb1c29d7f845528112dffc2f5dcadf148c2babbf764aa WatchSource:0}: Error finding container 210cd666780dad27d73bb1c29d7f845528112dffc2f5dcadf148c2babbf764aa: Status 404 returned error can't find the container with id 210cd666780dad27d73bb1c29d7f845528112dffc2f5dcadf148c2babbf764aa Jul 23 21:38:38.116217 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:38.116169 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qgrj7" event={"ID":"195e9eee-0482-4327-9e7b-2a5fcd592c4e","Type":"ContainerStarted","Data":"82e6021d4d0e3b0ffe5b8ca05ca8a9af9deedcb8b0bf1832cbdd257df4f57ebd"} Jul 23 21:38:38.118952 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:38.118877 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-przpb" event={"ID":"c9483f8c-93a6-4d98-bc0f-99cdc7055973","Type":"ContainerStarted","Data":"210cd666780dad27d73bb1c29d7f845528112dffc2f5dcadf148c2babbf764aa"} Jul 23 21:38:41.139007 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:41.138970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-przpb" event={"ID":"c9483f8c-93a6-4d98-bc0f-99cdc7055973","Type":"ContainerStarted","Data":"417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219"} Jul 23 21:38:41.140470 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:41.140448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qgrj7" event={"ID":"195e9eee-0482-4327-9e7b-2a5fcd592c4e","Type":"ContainerStarted","Data":"b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97"} Jul 23 21:38:41.155050 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:41.155007 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-przpb" podStartSLOduration=0.934772231 podStartE2EDuration="4.154995214s" totalImagesPullingTime="3.220222983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:38:41.153193376 +0000 UTC m=+754.480882095" watchObservedRunningTime="2026-07-23 21:38:41.154995214 +0000 UTC m=+754.482683910" Jul 23 21:38:41.167728 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:41.167679 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-qgrj7" podStartSLOduration=1.757768338 podStartE2EDuration="5.167661924s" totalImagesPullingTime="3.409893586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:38:41.166275228 +0000 UTC m=+754.493963946" watchObservedRunningTime="2026-07-23 21:38:41.167661924 +0000 UTC m=+754.495350647" Jul 23 21:38:41.191298 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:41.191262 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qgrj7"] Jul 23 21:38:43.149157 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:43.149119 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-qgrj7" podUID="195e9eee-0482-4327-9e7b-2a5fcd592c4e" containerName="authorino" containerID="cri-o://b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97" gracePeriod=30 Jul 23 21:38:43.384909 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:43.384889 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qgrj7" Jul 23 21:38:43.464967 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:43.464895 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbtrm\" (UniqueName: \"kubernetes.io/projected/195e9eee-0482-4327-9e7b-2a5fcd592c4e-kube-api-access-lbtrm\") pod \"195e9eee-0482-4327-9e7b-2a5fcd592c4e\" (UID: \"195e9eee-0482-4327-9e7b-2a5fcd592c4e\") " Jul 23 21:38:43.467133 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:43.467112 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/195e9eee-0482-4327-9e7b-2a5fcd592c4e-kube-api-access-lbtrm" (OuterVolumeSpecName: "kube-api-access-lbtrm") pod "195e9eee-0482-4327-9e7b-2a5fcd592c4e" (UID: "195e9eee-0482-4327-9e7b-2a5fcd592c4e"). InnerVolumeSpecName "kube-api-access-lbtrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:38:43.565868 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:43.565839 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbtrm\" (UniqueName: \"kubernetes.io/projected/195e9eee-0482-4327-9e7b-2a5fcd592c4e-kube-api-access-lbtrm\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:38:44.154115 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:44.154075 2576 generic.go:356] "Generic (PLEG): container finished" podID="195e9eee-0482-4327-9e7b-2a5fcd592c4e" containerID="b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97" exitCode=0 Jul 23 21:38:44.154520 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:44.154122 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qgrj7" Jul 23 21:38:44.154520 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:44.154156 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qgrj7" event={"ID":"195e9eee-0482-4327-9e7b-2a5fcd592c4e","Type":"ContainerDied","Data":"b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97"} Jul 23 21:38:44.154520 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:44.154200 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qgrj7" event={"ID":"195e9eee-0482-4327-9e7b-2a5fcd592c4e","Type":"ContainerDied","Data":"82e6021d4d0e3b0ffe5b8ca05ca8a9af9deedcb8b0bf1832cbdd257df4f57ebd"} Jul 23 21:38:44.154520 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:44.154220 2576 scope.go:117] "RemoveContainer" containerID="b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97" Jul 23 21:38:44.163174 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:44.163157 2576 scope.go:117] "RemoveContainer" containerID="b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97" Jul 23 21:38:44.163483 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:38:44.163462 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97\": container with ID starting with b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97 not found: ID does not exist" containerID="b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97" Jul 23 21:38:44.163560 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:44.163491 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97"} err="failed to get container status \"b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97\": rpc error: code = NotFound desc = could not find container \"b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97\": container with ID starting with b40e317a5dd551e1c1ea0567c72e16d7b7823295519e8c540472acba7e38dd97 not found: ID does not exist" Jul 23 21:38:44.176295 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:44.176266 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qgrj7"] Jul 23 21:38:44.179458 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:44.179437 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-qgrj7"] Jul 23 21:38:45.249114 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:45.249080 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="195e9eee-0482-4327-9e7b-2a5fcd592c4e" path="/var/lib/kubelet/pods/195e9eee-0482-4327-9e7b-2a5fcd592c4e/volumes" Jul 23 21:38:57.471674 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:57.471625 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:38:57.565909 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:57.565880 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:38:58.017853 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:38:58.017825 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:39:10.018360 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.018321 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:39:10.129876 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.129839 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:39:10.628581 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.628542 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-759d4c9dcc-lzp9b"] Jul 23 21:39:10.628964 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.628946 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="195e9eee-0482-4327-9e7b-2a5fcd592c4e" containerName="authorino" Jul 23 21:39:10.629055 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.628965 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="195e9eee-0482-4327-9e7b-2a5fcd592c4e" containerName="authorino" Jul 23 21:39:10.629115 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.629061 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="195e9eee-0482-4327-9e7b-2a5fcd592c4e" containerName="authorino" Jul 23 21:39:10.635365 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.635339 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-759d4c9dcc-lzp9b" Jul 23 21:39:10.638108 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.638080 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 23 21:39:10.641237 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.641172 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-759d4c9dcc-lzp9b"] Jul 23 21:39:10.703695 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.703668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/354b8067-caa7-474d-9a74-f3826d0432a2-tls-cert\") pod \"authorino-759d4c9dcc-lzp9b\" (UID: \"354b8067-caa7-474d-9a74-f3826d0432a2\") " pod="kuadrant-system/authorino-759d4c9dcc-lzp9b" Jul 23 21:39:10.703839 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.703702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vss8f\" (UniqueName: \"kubernetes.io/projected/354b8067-caa7-474d-9a74-f3826d0432a2-kube-api-access-vss8f\") pod \"authorino-759d4c9dcc-lzp9b\" (UID: \"354b8067-caa7-474d-9a74-f3826d0432a2\") " pod="kuadrant-system/authorino-759d4c9dcc-lzp9b" Jul 23 21:39:10.804583 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.804548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/354b8067-caa7-474d-9a74-f3826d0432a2-tls-cert\") pod \"authorino-759d4c9dcc-lzp9b\" (UID: \"354b8067-caa7-474d-9a74-f3826d0432a2\") " pod="kuadrant-system/authorino-759d4c9dcc-lzp9b" Jul 23 21:39:10.804758 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.804605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vss8f\" (UniqueName: \"kubernetes.io/projected/354b8067-caa7-474d-9a74-f3826d0432a2-kube-api-access-vss8f\") pod \"authorino-759d4c9dcc-lzp9b\" (UID: \"354b8067-caa7-474d-9a74-f3826d0432a2\") " pod="kuadrant-system/authorino-759d4c9dcc-lzp9b" Jul 23 21:39:10.807253 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.807223 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/354b8067-caa7-474d-9a74-f3826d0432a2-tls-cert\") pod \"authorino-759d4c9dcc-lzp9b\" (UID: \"354b8067-caa7-474d-9a74-f3826d0432a2\") " pod="kuadrant-system/authorino-759d4c9dcc-lzp9b" Jul 23 21:39:10.813303 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.813279 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vss8f\" (UniqueName: \"kubernetes.io/projected/354b8067-caa7-474d-9a74-f3826d0432a2-kube-api-access-vss8f\") pod \"authorino-759d4c9dcc-lzp9b\" (UID: \"354b8067-caa7-474d-9a74-f3826d0432a2\") " pod="kuadrant-system/authorino-759d4c9dcc-lzp9b" Jul 23 21:39:10.960571 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:10.960487 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-759d4c9dcc-lzp9b" Jul 23 21:39:11.097405 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:11.097383 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-759d4c9dcc-lzp9b"] Jul 23 21:39:11.099347 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:39:11.099317 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod354b8067_caa7_474d_9a74_f3826d0432a2.slice/crio-2b04ff9aca39f7f957fc790d6387426de307e1d41a8ed447194f29df6c294bdc WatchSource:0}: Error finding container 2b04ff9aca39f7f957fc790d6387426de307e1d41a8ed447194f29df6c294bdc: Status 404 returned error can't find the container with id 2b04ff9aca39f7f957fc790d6387426de307e1d41a8ed447194f29df6c294bdc Jul 23 21:39:11.277384 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:11.277303 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-759d4c9dcc-lzp9b" event={"ID":"354b8067-caa7-474d-9a74-f3826d0432a2","Type":"ContainerStarted","Data":"2b04ff9aca39f7f957fc790d6387426de307e1d41a8ed447194f29df6c294bdc"} Jul 23 21:39:12.282904 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:12.282870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-759d4c9dcc-lzp9b" event={"ID":"354b8067-caa7-474d-9a74-f3826d0432a2","Type":"ContainerStarted","Data":"3685e297d960ab62b26f21b152d13a19939f0b70720b50e415803fcee12f7076"} Jul 23 21:39:12.298255 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:12.298166 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-759d4c9dcc-lzp9b" podStartSLOduration=1.926453261 podStartE2EDuration="2.298150239s" totalImagesPullingTime="371.696978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 21:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:39:12.297402036 +0000 UTC m=+785.625090755" watchObservedRunningTime="2026-07-23 21:39:12.298150239 +0000 UTC m=+785.625838957" Jul 23 21:39:12.324514 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:12.324481 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-przpb"] Jul 23 21:39:12.324766 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:12.324718 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-przpb" podUID="c9483f8c-93a6-4d98-bc0f-99cdc7055973" containerName="authorino" containerID="cri-o://417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219" gracePeriod=30 Jul 23 21:39:12.564946 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:12.564917 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-przpb" Jul 23 21:39:12.620904 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:12.620871 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8jkh\" (UniqueName: \"kubernetes.io/projected/c9483f8c-93a6-4d98-bc0f-99cdc7055973-kube-api-access-c8jkh\") pod \"c9483f8c-93a6-4d98-bc0f-99cdc7055973\" (UID: \"c9483f8c-93a6-4d98-bc0f-99cdc7055973\") " Jul 23 21:39:12.623104 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:12.623075 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9483f8c-93a6-4d98-bc0f-99cdc7055973-kube-api-access-c8jkh" (OuterVolumeSpecName: "kube-api-access-c8jkh") pod "c9483f8c-93a6-4d98-bc0f-99cdc7055973" (UID: "c9483f8c-93a6-4d98-bc0f-99cdc7055973"). InnerVolumeSpecName "kube-api-access-c8jkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 21:39:12.722234 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:12.722193 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8jkh\" (UniqueName: \"kubernetes.io/projected/c9483f8c-93a6-4d98-bc0f-99cdc7055973-kube-api-access-c8jkh\") on node \"ip-10-0-134-221.ec2.internal\" DevicePath \"\"" Jul 23 21:39:13.287964 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:13.287933 2576 generic.go:356] "Generic (PLEG): container finished" podID="c9483f8c-93a6-4d98-bc0f-99cdc7055973" containerID="417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219" exitCode=0 Jul 23 21:39:13.288396 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:13.287971 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-przpb" Jul 23 21:39:13.288396 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:13.288011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-przpb" event={"ID":"c9483f8c-93a6-4d98-bc0f-99cdc7055973","Type":"ContainerDied","Data":"417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219"} Jul 23 21:39:13.288396 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:13.288053 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-przpb" event={"ID":"c9483f8c-93a6-4d98-bc0f-99cdc7055973","Type":"ContainerDied","Data":"210cd666780dad27d73bb1c29d7f845528112dffc2f5dcadf148c2babbf764aa"} Jul 23 21:39:13.288396 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:13.288073 2576 scope.go:117] "RemoveContainer" containerID="417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219" Jul 23 21:39:13.296416 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:13.296401 2576 scope.go:117] "RemoveContainer" containerID="417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219" Jul 23 21:39:13.296716 ip-10-0-134-221 kubenswrapper[2576]: E0723 21:39:13.296689 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219\": container with ID starting with 417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219 not found: ID does not exist" containerID="417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219" Jul 23 21:39:13.296824 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:13.296723 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219"} err="failed to get container status \"417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219\": rpc error: code = NotFound desc = could not find container \"417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219\": container with ID starting with 417ce4b6155aba276197b6cdc3a4a030e95278a8f745e4ad9bb650b17c9b5219 not found: ID does not exist" Jul 23 21:39:13.316772 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:13.316748 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-przpb"] Jul 23 21:39:13.326410 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:13.326390 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-przpb"] Jul 23 21:39:15.250004 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:15.249960 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9483f8c-93a6-4d98-bc0f-99cdc7055973" path="/var/lib/kubelet/pods/c9483f8c-93a6-4d98-bc0f-99cdc7055973/volumes" Jul 23 21:39:17.228047 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:17.228014 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:39:17.326073 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:17.326023 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:39:17.380917 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:17.380875 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:39:17.464071 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:17.464042 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:39:20.598870 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:20.598835 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:39:20.698527 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:20.698488 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:39:28.781780 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:28.781726 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:39:31.925348 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:39:31.925315 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:40:05.767245 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:40:05.767207 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:40:07.113874 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:40:07.113836 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:41:07.154365 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:41:07.154283 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5j52_01dab5b8-48b4-4745-8526-c822fa9110a2/ovn-acl-logging/0.log" Jul 23 21:41:07.155489 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:41:07.155469 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5j52_01dab5b8-48b4-4745-8526-c822fa9110a2/ovn-acl-logging/0.log" Jul 23 21:42:26.790428 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:42:26.790392 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:42:26.876548 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:42:26.876515 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:44:31.701255 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:44:31.701223 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:44:35.426136 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:44:35.426101 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:45:53.862648 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:45:53.862598 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:46:07.184020 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:46:07.183989 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5j52_01dab5b8-48b4-4745-8526-c822fa9110a2/ovn-acl-logging/0.log" Jul 23 21:46:07.186492 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:46:07.186470 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5j52_01dab5b8-48b4-4745-8526-c822fa9110a2/ovn-acl-logging/0.log" Jul 23 21:46:45.077649 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:46:45.077596 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:49:25.960341 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:25.960302 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:49:40.104654 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:40.104584 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-759d4c9dcc-lzp9b_354b8067-caa7-474d-9a74-f3826d0432a2/authorino/0.log" Jul 23 21:49:46.274455 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:46.274425 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75db77d775-cn7xh_68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9/copy-manifests/0.log" Jul 23 21:49:46.282298 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:46.282275 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75db77d775-cn7xh_68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9/manager/0.log" Jul 23 21:49:47.936751 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:47.936723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-759d4c9dcc-lzp9b_354b8067-caa7-474d-9a74-f3826d0432a2/authorino/0.log" Jul 23 21:49:48.278999 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:48.278919 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6k9sb_eda5634b-5f05-408e-8d82-86ac2e0fdf6b/kuadrant-console-plugin/0.log" Jul 23 21:49:49.445290 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:49.445239 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b88774c5c-86g5k_1d88982d-42d0-4d4a-ae18-3d27cdb08aab/kube-auth-proxy/0.log" Jul 23 21:49:49.561352 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:49.561323 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gq6bm_16ee5216-5b61-441f-8777-2d26512f9f3c/istio-proxy/0.log" Jul 23 21:49:56.512071 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:56.512014 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:49:56.640674 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:56.640620 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" limit=1024 Jul 23 21:49:58.889600 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:58.889514 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fphrs_b4c019a8-492c-4736-9e54-0289503edc1e/global-pull-secret-syncer/0.log" Jul 23 21:49:59.024783 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:59.024745 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-db8zd_990c00b8-e5ad-4b21-bf34-c12b41718ef6/konnectivity-agent/0.log" Jul 23 21:49:59.146594 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:49:59.146508 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-221.ec2.internal_647c551053bf7872d88b0557b63ff6dd/haproxy/0.log" Jul 23 21:50:04.592470 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:04.592429 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-759d4c9dcc-lzp9b_354b8067-caa7-474d-9a74-f3826d0432a2/authorino/0.log" Jul 23 21:50:04.688646 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:04.688613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6k9sb_eda5634b-5f05-408e-8d82-86ac2e0fdf6b/kuadrant-console-plugin/0.log" Jul 23 21:50:06.698853 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:06.698774 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-856589ddb5-drw57_06d46f0e-e98f-4d08-86ab-1b0a96b30de9/metrics-server/0.log" Jul 23 21:50:06.724666 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:06.724622 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-gg8zg_124b6395-f477-445f-ab6d-d95db8229c1d/monitoring-plugin/0.log" Jul 23 21:50:06.839217 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:06.839194 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-85x6b_1c94bbee-d7cc-4fca-8fa1-4acff5f329c6/node-exporter/0.log" Jul 23 21:50:06.859957 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:06.859935 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-85x6b_1c94bbee-d7cc-4fca-8fa1-4acff5f329c6/kube-rbac-proxy/0.log" Jul 23 21:50:06.880111 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:06.880089 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-85x6b_1c94bbee-d7cc-4fca-8fa1-4acff5f329c6/init-textfile/0.log" Jul 23 21:50:07.077813 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:07.077786 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd094e3b-8102-4c52-9fc6-07ec26b44c6e/prometheus/0.log" Jul 23 21:50:07.097713 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:07.097679 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd094e3b-8102-4c52-9fc6-07ec26b44c6e/config-reloader/0.log" Jul 23 21:50:07.119661 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:07.119609 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd094e3b-8102-4c52-9fc6-07ec26b44c6e/thanos-sidecar/0.log" Jul 23 21:50:07.141154 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:07.141118 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd094e3b-8102-4c52-9fc6-07ec26b44c6e/kube-rbac-proxy-web/0.log" Jul 23 21:50:07.161072 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:07.161045 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd094e3b-8102-4c52-9fc6-07ec26b44c6e/kube-rbac-proxy/0.log" Jul 23 21:50:07.181469 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:07.181446 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd094e3b-8102-4c52-9fc6-07ec26b44c6e/kube-rbac-proxy-thanos/0.log" Jul 23 21:50:07.205932 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:07.205915 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dd094e3b-8102-4c52-9fc6-07ec26b44c6e/init-config-reloader/0.log" Jul 23 21:50:07.230214 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:07.230194 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-9fhtp_22b46968-3a5b-4428-a3ae-3bebf77aac15/prometheus-operator/0.log" Jul 23 21:50:07.251413 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:07.251369 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-9fhtp_22b46968-3a5b-4428-a3ae-3bebf77aac15/kube-rbac-proxy/0.log" Jul 23 21:50:08.241534 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.241503 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn"] Jul 23 21:50:08.241934 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.241851 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9483f8c-93a6-4d98-bc0f-99cdc7055973" containerName="authorino" Jul 23 21:50:08.241934 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.241862 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9483f8c-93a6-4d98-bc0f-99cdc7055973" containerName="authorino" Jul 23 21:50:08.242031 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.241940 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9483f8c-93a6-4d98-bc0f-99cdc7055973" containerName="authorino" Jul 23 21:50:08.244157 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.244142 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.246749 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.246726 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m4gt\"/\"kube-root-ca.crt\"" Jul 23 21:50:08.247778 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.247754 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m4gt\"/\"openshift-service-ca.crt\"" Jul 23 21:50:08.247778 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.247768 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7m4gt\"/\"default-dockercfg-t8fz8\"" Jul 23 21:50:08.253056 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.253033 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn"] Jul 23 21:50:08.351230 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.351196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/440974bc-ac84-4465-8697-12828d4b2cae-lib-modules\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.351230 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.351235 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/440974bc-ac84-4465-8697-12828d4b2cae-proc\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.351549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.351253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/440974bc-ac84-4465-8697-12828d4b2cae-podres\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.351549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.351334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v9s9\" (UniqueName: \"kubernetes.io/projected/440974bc-ac84-4465-8697-12828d4b2cae-kube-api-access-2v9s9\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.351549 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.351385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/440974bc-ac84-4465-8697-12828d4b2cae-sys\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.452010 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.451974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/440974bc-ac84-4465-8697-12828d4b2cae-sys\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.452156 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.452060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/440974bc-ac84-4465-8697-12828d4b2cae-lib-modules\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.452156 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.452087 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/440974bc-ac84-4465-8697-12828d4b2cae-proc\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.452156 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.452099 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/440974bc-ac84-4465-8697-12828d4b2cae-sys\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.452156 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.452101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/440974bc-ac84-4465-8697-12828d4b2cae-podres\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.452156 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.452145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v9s9\" (UniqueName: \"kubernetes.io/projected/440974bc-ac84-4465-8697-12828d4b2cae-kube-api-access-2v9s9\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.452316 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.452191 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/440974bc-ac84-4465-8697-12828d4b2cae-proc\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.452316 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.452210 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/440974bc-ac84-4465-8697-12828d4b2cae-podres\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.452316 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.452230 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/440974bc-ac84-4465-8697-12828d4b2cae-lib-modules\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.460336 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.460308 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v9s9\" (UniqueName: \"kubernetes.io/projected/440974bc-ac84-4465-8697-12828d4b2cae-kube-api-access-2v9s9\") pod \"perf-node-gather-daemonset-zzxwn\" (UID: \"440974bc-ac84-4465-8697-12828d4b2cae\") " pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.554600 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.554570 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:08.686333 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:08.686307 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn"] Jul 23 21:50:08.689049 ip-10-0-134-221 kubenswrapper[2576]: W0723 21:50:08.689013 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod440974bc_ac84_4465_8697_12828d4b2cae.slice/crio-bcf8e809351f9d4b692a8f0d38c4909ea804690a627732a6f5cc366525c39149 WatchSource:0}: Error finding container bcf8e809351f9d4b692a8f0d38c4909ea804690a627732a6f5cc366525c39149: Status 404 returned error can't find the container with id bcf8e809351f9d4b692a8f0d38c4909ea804690a627732a6f5cc366525c39149 Jul 23 21:50:09.179148 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:09.179092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" event={"ID":"440974bc-ac84-4465-8697-12828d4b2cae","Type":"ContainerStarted","Data":"95c979b7cdb9e15392be22b57426f4bd9ff7eaee46d8b92dbe819f4600f9bf6d"} Jul 23 21:50:09.179354 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:09.179159 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" event={"ID":"440974bc-ac84-4465-8697-12828d4b2cae","Type":"ContainerStarted","Data":"bcf8e809351f9d4b692a8f0d38c4909ea804690a627732a6f5cc366525c39149"} Jul 23 21:50:09.179354 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:09.179261 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:09.194216 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:09.194167 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" podStartSLOduration=1.194150426 podStartE2EDuration="1.194150426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 21:50:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 21:50:09.193113682 +0000 UTC m=+1442.520802425" watchObservedRunningTime="2026-07-23 21:50:09.194150426 +0000 UTC m=+1442.521839143" Jul 23 21:50:10.321610 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:10.321569 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-z2rkq_5d647179-e8b3-484e-b732-9b007bfd84ab/volume-data-source-validator/0.log" Jul 23 21:50:11.308223 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:11.308188 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-665rd_6e846bbf-3d90-4e9c-b16d-781db1c99dc8/dns/0.log" Jul 23 21:50:11.329820 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:11.329790 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-665rd_6e846bbf-3d90-4e9c-b16d-781db1c99dc8/kube-rbac-proxy/0.log" Jul 23 21:50:11.466971 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:11.466940 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qzzbv_9dd834fa-cfaf-4978-8827-e8885dde51fc/dns-node-resolver/0.log" Jul 23 21:50:12.035170 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:12.035139 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-677bd4fbc7-xgdst_fbcf5f0e-ad40-42ad-83e0-f8a0c8e25618/registry/0.log" Jul 23 21:50:12.086260 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:12.086231 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8s2x6_f16ca22b-c9f7-4d03-bd6c-b8e38a72777e/node-ca/0.log" Jul 23 21:50:13.145085 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:13.145057 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b88774c5c-86g5k_1d88982d-42d0-4d4a-ae18-3d27cdb08aab/kube-auth-proxy/0.log" Jul 23 21:50:13.170394 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:13.170367 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gq6bm_16ee5216-5b61-441f-8777-2d26512f9f3c/istio-proxy/0.log" Jul 23 21:50:13.758744 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:13.758718 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-998p4_cabbcb56-db1a-47bf-a01e-3e5e96c10812/serve-healthcheck-canary/0.log" Jul 23 21:50:14.289455 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:14.289418 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-vwkpc_a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f/insights-operator/0.log" Jul 23 21:50:14.289853 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:14.289766 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-vwkpc_a8ef6c79-75c7-4ce2-b753-bf2c3c0a819f/insights-operator/1.log" Jul 23 21:50:14.442764 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:14.442723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zbh6x_b6390148-2edc-4a19-b84c-6c06a0d79c8e/kube-rbac-proxy/0.log" Jul 23 21:50:14.461147 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:14.461122 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zbh6x_b6390148-2edc-4a19-b84c-6c06a0d79c8e/exporter/0.log" Jul 23 21:50:14.483146 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:14.483126 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zbh6x_b6390148-2edc-4a19-b84c-6c06a0d79c8e/extractor/0.log" Jul 23 21:50:15.193888 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:15.193860 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7m4gt/perf-node-gather-daemonset-zzxwn" Jul 23 21:50:16.842032 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:16.841985 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75db77d775-cn7xh_68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9/manager/0.log" Jul 23 21:50:16.866034 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:16.866009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75db77d775-cn7xh_68e633f0-c44e-4b65-b7f4-5c91b2d5f8c9/copy-manifests/0.log" Jul 23 21:50:18.317896 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:18.317870 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-746c6b6887-7dqsb_4ac38004-6e58-41d8-a6a7-d085f9bddb29/manager/0.log" Jul 23 21:50:19.248679 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:19.248613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b88774c5c-86g5k_1d88982d-42d0-4d4a-ae18-3d27cdb08aab/kube-auth-proxy/0.log" Jul 23 21:50:19.266033 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:19.265964 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gq6bm_16ee5216-5b61-441f-8777-2d26512f9f3c/istio-proxy/0.log" Jul 23 21:50:20.355009 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:20.354985 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b88774c5c-86g5k_1d88982d-42d0-4d4a-ae18-3d27cdb08aab/kube-auth-proxy/0.log" Jul 23 21:50:20.368789 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:20.368767 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-gq6bm_16ee5216-5b61-441f-8777-2d26512f9f3c/istio-proxy/0.log" Jul 23 21:50:23.251914 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:23.251886 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-4q5xx_234a9ac5-7e43-4b49-b018-f7e8fa03a161/migrator/0.log" Jul 23 21:50:23.271137 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:23.271100 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-4q5xx_234a9ac5-7e43-4b49-b018-f7e8fa03a161/graceful-termination/0.log" Jul 23 21:50:24.653358 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:24.653329 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fbxr_c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b/kube-multus-additional-cni-plugins/0.log" Jul 23 21:50:24.673062 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:24.673036 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fbxr_c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b/egress-router-binary-copy/0.log" Jul 23 21:50:24.692658 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:24.692619 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fbxr_c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b/cni-plugins/0.log" Jul 23 21:50:24.715264 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:24.715239 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fbxr_c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b/bond-cni-plugin/0.log" Jul 23 21:50:24.735167 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:24.735144 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fbxr_c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b/routeoverride-cni/0.log" Jul 23 21:50:24.754500 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:24.754481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fbxr_c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b/whereabouts-cni-bincopy/0.log" Jul 23 21:50:24.774914 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:24.774893 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4fbxr_c894edd7-9d1b-4c9f-b4b0-9fd975c4a93b/whereabouts-cni/0.log" Jul 23 21:50:25.101147 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:25.101122 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tnq6d_89acf8e9-7306-40b8-8bc1-9d3aff799648/kube-multus/0.log" Jul 23 21:50:25.168362 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:25.168336 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f27wm_a7c3140f-42f4-4305-a9de-0f4ab5240702/network-metrics-daemon/0.log" Jul 23 21:50:25.187442 ip-10-0-134-221 kubenswrapper[2576]: I0723 21:50:25.187418 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f27wm_a7c3140f-42f4-4305-a9de-0f4ab5240702/kube-rbac-proxy/0.log"