Jul 07 01:01:13.864591 ip-10-0-130-147 systemd[1]: Starting Kubernetes Kubelet... Jul 07 01:01:14.308847 ip-10-0-130-147 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 01:01:14.308847 ip-10-0-130-147 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 01:01:14.308847 ip-10-0-130-147 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 01:01:14.309407 ip-10-0-130-147 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 01:01:14.309407 ip-10-0-130-147 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 01:01:14.311759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.311623 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 01:01:14.315662 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315647 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 01:01:14.315662 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315662 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315666 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315670 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315673 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315676 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315678 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315682 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315685 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315687 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315690 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315693 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315695 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315698 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315701 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315703 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315707 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315709 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315712 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315714 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315717 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 01:01:14.315726 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315720 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315722 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315725 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315727 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315730 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315733 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315736 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315738 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315741 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315743 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315746 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315749 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315752 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315755 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315757 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315760 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315762 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315764 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315767 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315769 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 01:01:14.316215 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315772 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315774 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315777 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315780 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315782 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315784 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315789 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315793 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315796 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315798 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315801 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315804 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315807 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315809 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315812 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315814 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315817 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315820 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315822 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315825 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 01:01:14.316700 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315827 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315830 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315832 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315835 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315837 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315840 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315842 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315845 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315847 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315850 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315853 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315856 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315858 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315860 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315863 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315865 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315868 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315870 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315873 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315876 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 01:01:14.317210 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315880 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315883 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315886 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315889 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315892 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315895 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315898 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315901 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315904 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315906 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315909 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315913 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315916 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315918 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315921 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315924 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315927 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.315929 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317527 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317535 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 01:01:14.317707 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317539 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317542 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317553 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317555 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317558 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317561 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317564 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317566 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317569 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317572 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317574 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317577 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317580 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317585 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317589 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317592 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317594 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317597 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317600 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 01:01:14.318214 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317603 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317606 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317609 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317611 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317613 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317616 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317618 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317621 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317623 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317626 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317628 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317631 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317633 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317636 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317639 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317642 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317644 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317647 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317649 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317653 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 01:01:14.318742 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317657 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317660 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317662 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317665 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317667 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317670 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317672 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317675 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317678 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317680 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317683 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317686 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317688 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317691 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317693 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317696 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317698 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317706 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317709 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317711 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 01:01:14.319220 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317714 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317716 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317720 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317722 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317725 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317727 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317730 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317732 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317735 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317737 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317740 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317742 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317744 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317747 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317749 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317752 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317754 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317757 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317760 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317764 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 01:01:14.319720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317769 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317773 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317776 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317778 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317781 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317784 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317787 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317790 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317793 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317795 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317798 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317800 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317803 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317805 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317808 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317810 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317812 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.317815 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318242 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318247 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 01:01:14.320208 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318251 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318255 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318275 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318279 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318282 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318285 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318288 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318291 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318294 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318297 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318300 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318304 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318307 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318310 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318312 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318315 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318318 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318320 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318323 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318326 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 01:01:14.320696 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318328 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318331 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318333 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318336 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318338 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318341 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318343 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318346 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318348 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318351 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318354 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318356 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318359 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318361 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318364 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318366 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318369 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318371 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318373 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318376 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 01:01:14.321186 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318379 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318381 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318384 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318387 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318390 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318394 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318398 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318401 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318404 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318407 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318410 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318412 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318415 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318418 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318420 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318423 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318425 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318427 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318430 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318432 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 01:01:14.321709 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318435 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318437 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318440 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318442 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318444 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318447 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318449 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318453 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318456 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318459 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318463 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318466 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318469 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318472 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318476 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318479 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318481 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318485 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318487 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318490 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 01:01:14.322188 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318493 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318495 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318498 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318500 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318503 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318505 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318508 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318510 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318513 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318515 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318517 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318520 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318522 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318525 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318527 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318529 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.318532 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318601 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318612 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318619 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318623 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 01:01:14.322680 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318627 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318631 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318635 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318639 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318643 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318647 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318650 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318653 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318656 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318660 2576 flags.go:64] FLAG: --cgroup-root="" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318663 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318666 2576 flags.go:64] FLAG: --client-ca-file="" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318669 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318671 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318675 2576 flags.go:64] FLAG: --cluster-domain="" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318678 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318681 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318684 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318687 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318690 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318693 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318696 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318699 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318702 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 07 01:01:14.323177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318705 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318707 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318710 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318713 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318717 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318720 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318722 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318725 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318728 2576 flags.go:64] FLAG: --enable-server="true" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318731 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318736 2576 flags.go:64] FLAG: --event-burst="100" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318741 2576 flags.go:64] FLAG: --event-qps="50" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318744 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318747 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318750 2576 flags.go:64] FLAG: --eviction-hard="" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318753 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318756 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318759 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318762 2576 flags.go:64] FLAG: --eviction-soft="" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318765 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318768 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318770 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318773 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318776 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318779 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 01:01:14.323760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318781 2576 flags.go:64] FLAG: --feature-gates="" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318785 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318787 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318790 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318793 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318796 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318799 2576 flags.go:64] FLAG: --help="false" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318802 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318805 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318807 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318810 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318813 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318817 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318819 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318822 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318825 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318827 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318830 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318835 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318838 2576 flags.go:64] FLAG: --kube-reserved="" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318840 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318843 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318846 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318848 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 01:01:14.324418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318851 2576 flags.go:64] FLAG: --lock-file="" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318854 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318857 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318860 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318866 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318868 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318871 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318873 2576 flags.go:64] FLAG: --logging-format="text" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318876 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318879 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318882 2576 flags.go:64] FLAG: --manifest-url="" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318884 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318888 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318891 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318895 2576 flags.go:64] FLAG: --max-pods="110" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318897 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318900 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318903 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318905 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318908 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318911 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318914 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318920 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318924 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318926 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 01:01:14.325122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318929 2576 flags.go:64] FLAG: --pod-cidr="" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318934 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318939 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318941 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318944 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318947 2576 flags.go:64] FLAG: --port="10250" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318950 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318953 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0283855e1406de066" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318956 2576 flags.go:64] FLAG: --qos-reserved="" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318959 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318962 2576 flags.go:64] FLAG: --register-node="true" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318966 2576 flags.go:64] FLAG: --register-with-taints="" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318969 2576 flags.go:64] FLAG: --registry-burst="10" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318972 2576 flags.go:64] FLAG: --registry-qps="5" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318975 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318977 2576 flags.go:64] FLAG: --reserved-memory="" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318989 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318992 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318995 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.318998 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319001 2576 flags.go:64] FLAG: --runonce="false" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319003 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319007 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319009 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319012 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 01:01:14.325759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319015 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319018 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319022 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319025 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319027 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319030 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319033 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319035 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319039 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319042 2576 flags.go:64] FLAG: --system-cgroups="" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319045 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319050 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319052 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319055 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319059 2576 flags.go:64] FLAG: --tls-min-version="" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319061 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319064 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319067 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319071 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319073 2576 flags.go:64] FLAG: --v="2" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319077 2576 flags.go:64] FLAG: --version="false" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319081 2576 flags.go:64] FLAG: --vmodule="" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319084 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.319087 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319202 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 01:01:14.326481 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319205 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319208 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319211 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319214 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319217 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319220 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319222 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319227 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319229 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319233 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319236 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319238 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319240 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319243 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319245 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319249 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319252 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319254 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319257 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319274 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 01:01:14.327405 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319276 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319279 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319281 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319284 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319286 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319289 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319292 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319295 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319297 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319300 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319302 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319305 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319307 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319309 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319312 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319314 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319317 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319319 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319322 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319325 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 01:01:14.327982 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319328 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319331 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319333 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319336 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319338 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319341 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319343 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319347 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319351 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319354 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319357 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319359 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319362 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319365 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319367 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319371 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319374 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319377 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319379 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 01:01:14.328533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319383 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319385 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319388 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319390 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319394 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319397 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319400 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319403 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319405 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319408 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319410 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319413 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319417 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319420 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319422 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319424 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319427 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319429 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319432 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 01:01:14.328990 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319434 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319438 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319440 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319443 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319445 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319448 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319450 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319453 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319455 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319458 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319460 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319462 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319465 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319467 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319470 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319473 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319475 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319477 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319479 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 01:01:14.329523 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.319482 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.320297 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.329469 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.329486 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.329505 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.329511 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329567 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329572 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329576 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329579 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329581 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329585 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329588 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329591 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329593 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 01:01:14.329973 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329596 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329598 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329601 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329603 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329606 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329608 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329612 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329616 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329619 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329622 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329624 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329627 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329630 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329637 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329640 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329642 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329645 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329647 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329650 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 01:01:14.330371 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329652 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329655 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329658 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329660 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329663 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329665 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329668 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329670 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329673 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329675 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329678 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329680 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329683 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329685 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329688 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329690 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329693 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329696 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329698 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329700 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 01:01:14.330838 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329703 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329705 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329708 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329710 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329714 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329718 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329721 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329724 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329726 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329729 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329732 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329735 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329738 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329741 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329744 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329746 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329749 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329751 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329754 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 01:01:14.331417 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329756 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329759 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329761 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329764 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329766 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329769 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329771 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329774 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329776 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329778 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329781 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329784 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329787 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329789 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329792 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329794 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329797 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329800 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329804 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329807 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 01:01:14.331874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329809 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329812 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329814 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329817 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329819 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329821 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329825 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329828 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329831 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329833 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329836 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329838 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.329843 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329960 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329965 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 01:01:14.332376 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329968 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329971 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329975 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329979 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329983 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329986 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329988 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329992 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329995 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.329998 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330002 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330005 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330007 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330010 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330012 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330015 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330017 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330020 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330022 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 01:01:14.332746 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330026 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330029 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330032 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330035 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330038 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330042 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330045 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330047 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330050 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330052 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330055 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330057 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330060 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330063 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330065 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330067 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330070 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330072 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330074 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330077 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 01:01:14.333222 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330079 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330081 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330084 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330086 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330089 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330091 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330094 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330096 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330098 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330101 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330103 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330106 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330108 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330110 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330113 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330115 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330118 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330121 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330124 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330126 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 01:01:14.333720 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330129 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330131 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330134 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330136 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330138 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330141 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330143 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330146 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330148 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330150 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330153 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330155 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330158 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330160 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330162 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330165 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330167 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330170 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330173 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330175 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 01:01:14.334192 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330178 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330180 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330182 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330184 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330187 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330189 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330191 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330194 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330196 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330199 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330202 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330204 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330206 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330209 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330211 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330214 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330216 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 01:01:14.334698 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:14.330218 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 01:01:14.335109 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.330224 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 01:01:14.335109 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.330361 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 01:01:14.335109 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.332849 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 01:01:14.335109 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.334536 2576 server.go:1019] "Starting client certificate rotation" Jul 07 01:01:14.335109 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.334638 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 01:01:14.335109 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.334672 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 01:01:14.337618 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.337604 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 01:01:14.339991 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.339975 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 01:01:14.353710 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.353683 2576 log.go:25] "Validated CRI v1 runtime API" Jul 07 01:01:14.356965 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.356948 2576 log.go:25] "Validated CRI v1 image API" Jul 07 01:01:14.357805 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.357789 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 01:01:14.360543 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.360523 2576 fs.go:135] Filesystem UUIDs: map[63a22c82-6730-49cd-949b-f96ed8e5c755:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d89ad14a-0b23-422a-8bde-79b4a66ba8a8:/dev/nvme0n1p4] Jul 07 01:01:14.360606 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.360542 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 01:01:14.366724 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.366611 2576 manager.go:216] Machine: {Timestamp:2026-07-07 01:01:14.366116066 +0000 UTC m=+0.372522840 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3074396 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d678adcc06baa33c4dc206bd53739 SystemUUID:ec2d678a-dcc0-6baa-33c4-dc206bd53739 BootID:93e5577d-fe22-4ab1-b598-1b3c185b08e3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:db:0f:92:cc:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:db:0f:92:cc:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:0e:18:7a:26:83 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 01:01:14.366724 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.366711 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 01:01:14.366856 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.366738 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 01:01:14.366856 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.366793 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 01:01:14.369844 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.369819 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 01:01:14.369985 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.369846 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-147.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 01:01:14.370770 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.370761 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 01:01:14.370801 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.370772 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 01:01:14.370801 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.370780 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 01:01:14.371762 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.371752 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 01:01:14.373535 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.373524 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 01:01:14.378815 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.378801 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 07 01:01:14.378951 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.378940 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 01:01:14.378995 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.378971 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 07 01:01:14.378995 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.378980 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 01:01:14.378995 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.378995 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 01:01:14.379108 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.379008 2576 kubelet.go:398] "Adding apiserver pod source" Jul 07 01:01:14.379108 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.379016 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 01:01:14.379422 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.379410 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 01:01:14.379471 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.379437 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 01:01:14.381844 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.381829 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 01:01:14.383585 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.383570 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4kwqh" Jul 07 01:01:14.384313 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.384299 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 01:01:14.384363 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.384330 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 01:01:14.386394 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.386380 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 01:01:14.386444 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.386402 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 01:01:14.386444 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.386408 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 01:01:14.386444 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.386414 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 01:01:14.386444 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.386422 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 01:01:14.386444 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.386428 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 01:01:14.386444 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.386436 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 01:01:14.386600 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.386451 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 01:01:14.386600 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.386459 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 01:01:14.386600 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.386464 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 01:01:14.386600 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.386490 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 01:01:14.386600 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.386495 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 01:01:14.387463 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.387442 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 01:01:14.387521 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.387488 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 01:01:14.388067 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.388054 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 01:01:14.388067 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.388067 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 01:01:14.391091 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.391072 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4kwqh" Jul 07 01:01:14.391956 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.391941 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-147.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 01:01:14.393237 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.393224 2576 server.go:1268] "Started kubelet" Jul 07 01:01:14.393384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.393314 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 01:01:14.393475 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.393373 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 01:01:14.393475 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.393443 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 01:01:14.394104 ip-10-0-130-147 systemd[1]: Started Kubernetes Kubelet. Jul 07 01:01:14.395021 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.394993 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 01:01:14.396496 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.396480 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 07 01:01:14.397503 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.397485 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 01:01:14.399227 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.398154 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-147.ec2.internal.18bfdc2f95959cfb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-147.ec2.internal,UID:ip-10-0-130-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-147.ec2.internal,},FirstTimestamp:2026-07-07 01:01:14.393189627 +0000 UTC m=+0.399596400,LastTimestamp:2026-07-07 01:01:14.393189627 +0000 UTC m=+0.399596400,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-147.ec2.internal,}" Jul 07 01:01:14.402437 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.402422 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 01:01:14.402437 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.402424 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 01:01:14.402573 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.402540 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:14.403205 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.403188 2576 factory.go:55] Registering systemd factory Jul 07 01:01:14.403302 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.403209 2576 factory.go:223] Registration of the systemd container factory successfully Jul 07 01:01:14.403302 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.403213 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 01:01:14.403302 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.403238 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 01:01:14.403302 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.403251 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 01:01:14.403467 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.403338 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 07 01:01:14.403467 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.403348 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 07 01:01:14.403467 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.403424 2576 factory.go:153] Registering CRI-O factory Jul 07 01:01:14.403467 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.403435 2576 factory.go:223] Registration of the crio container factory successfully Jul 07 01:01:14.403722 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.403474 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 01:01:14.403722 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.403498 2576 factory.go:103] Registering Raw factory Jul 07 01:01:14.403722 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.403510 2576 manager.go:1196] Started watching for new ooms in manager Jul 07 01:01:14.404497 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.404476 2576 manager.go:349] Starting recovery of all containers Jul 07 01:01:14.411627 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.411607 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 01:01:14.413564 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.413542 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-147.ec2.internal\" not found" node="ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.416324 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.416309 2576 manager.go:354] Recovery completed Jul 07 01:01:14.417504 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.417481 2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 07 01:01:14.420745 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.420730 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 01:01:14.427180 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.427162 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientMemory" Jul 07 01:01:14.427290 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.427198 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 01:01:14.427290 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.427212 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientPID" Jul 07 01:01:14.427782 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.427768 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 01:01:14.427860 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.427781 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 01:01:14.427860 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.427803 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 07 01:01:14.427860 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.427804 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 01:01:14.428900 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.428881 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientMemory" Jul 07 01:01:14.428984 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.428914 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 01:01:14.428984 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.428926 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientPID" Jul 07 01:01:14.429973 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.429961 2576 policy_none.go:49] "None policy: Start" Jul 07 01:01:14.430017 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.429977 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 01:01:14.430017 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.429988 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 01:01:14.431870 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.431859 2576 policy_none.go:47] "Start" Jul 07 01:01:14.486937 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.465708 2576 manager.go:337] "Starting Device Plugin manager" Jul 07 01:01:14.486937 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.465928 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 01:01:14.486937 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.465943 2576 server.go:87] "Starting device plugin registration server" Jul 07 01:01:14.486937 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.466186 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 01:01:14.486937 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.466198 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 01:01:14.486937 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.466311 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 01:01:14.486937 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.466501 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 01:01:14.486937 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.466516 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 01:01:14.486937 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.467005 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 01:01:14.486937 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.467055 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:14.540711 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.540676 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 01:01:14.542050 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.542035 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 01:01:14.542117 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.542070 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 01:01:14.542117 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.542092 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 01:01:14.542191 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.542130 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 01:01:14.544176 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.544126 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 01:01:14.566533 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.566454 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 01:01:14.567472 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.567447 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientMemory" Jul 07 01:01:14.567578 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.567478 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 01:01:14.567578 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.567494 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientPID" Jul 07 01:01:14.567578 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.567516 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.575645 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.575629 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.575723 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.575653 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-147.ec2.internal\": node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:14.595277 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.595234 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:14.642882 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.642847 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-147.ec2.internal"] Jul 07 01:01:14.643033 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.642925 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 01:01:14.645033 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.645018 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientMemory" Jul 07 01:01:14.645123 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.645053 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 01:01:14.645123 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.645063 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientPID" Jul 07 01:01:14.647448 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.647436 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 01:01:14.647581 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.647567 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.647640 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.647598 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 01:01:14.648883 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.648863 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientMemory" Jul 07 01:01:14.648985 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.648891 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 01:01:14.648985 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.648901 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientPID" Jul 07 01:01:14.648985 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.648933 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientMemory" Jul 07 01:01:14.648985 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.648953 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 01:01:14.648985 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.648961 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientPID" Jul 07 01:01:14.651222 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.651200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.651336 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.651233 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 01:01:14.652755 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.652739 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientMemory" Jul 07 01:01:14.652857 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.652778 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 01:01:14.652857 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.652793 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeHasSufficientPID" Jul 07 01:01:14.671057 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.671039 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-147.ec2.internal\" not found" node="ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.675733 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.675718 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-147.ec2.internal\" not found" node="ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.696304 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.696283 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:14.705222 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.705205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b72bcb08528402effabea26e9d8f58b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal\" (UID: \"4b72bcb08528402effabea26e9d8f58b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.705310 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.705230 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05558f760ed54fc5f15c38b24f368f0e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-147.ec2.internal\" (UID: \"05558f760ed54fc5f15c38b24f368f0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.705310 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.705247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b72bcb08528402effabea26e9d8f58b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal\" (UID: \"4b72bcb08528402effabea26e9d8f58b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.796388 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.796352 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:14.805689 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.805670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05558f760ed54fc5f15c38b24f368f0e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-147.ec2.internal\" (UID: \"05558f760ed54fc5f15c38b24f368f0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.805761 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.805694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b72bcb08528402effabea26e9d8f58b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal\" (UID: \"4b72bcb08528402effabea26e9d8f58b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.805761 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.805721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b72bcb08528402effabea26e9d8f58b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal\" (UID: \"4b72bcb08528402effabea26e9d8f58b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.805761 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.805747 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b72bcb08528402effabea26e9d8f58b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal\" (UID: \"4b72bcb08528402effabea26e9d8f58b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.805883 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.805777 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/05558f760ed54fc5f15c38b24f368f0e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-147.ec2.internal\" (UID: \"05558f760ed54fc5f15c38b24f368f0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.805883 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.805784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b72bcb08528402effabea26e9d8f58b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal\" (UID: \"4b72bcb08528402effabea26e9d8f58b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.897219 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.897141 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:14.974653 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.974611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.980084 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:14.979927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-147.ec2.internal" Jul 07 01:01:14.997725 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:14.997694 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:15.098314 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:15.098277 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:15.198820 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:15.198751 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:15.299367 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:15.299329 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:15.333779 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:15.333754 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 01:01:15.334226 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:15.333887 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 01:01:15.334226 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:15.333910 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 01:01:15.397443 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:15.397409 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 00:56:15 +0000 UTC" deadline="2028-01-06 12:40:57.183755209 +0000 UTC" Jul 07 01:01:15.397443 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:15.397438 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13163h39m41.786320931s" Jul 07 01:01:15.399551 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:15.399535 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:15.500024 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:15.499995 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:15.600109 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:15.600081 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:15.601533 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:15.601508 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05558f760ed54fc5f15c38b24f368f0e.slice/crio-45cd16e0951e749004d2b47f2f418bd2bb965910c518b196601567e334da8eb0 WatchSource:0}: Error finding container 45cd16e0951e749004d2b47f2f418bd2bb965910c518b196601567e334da8eb0: Status 404 returned error can't find the container with id 45cd16e0951e749004d2b47f2f418bd2bb965910c518b196601567e334da8eb0 Jul 07 01:01:15.601775 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:15.601748 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b72bcb08528402effabea26e9d8f58b.slice/crio-d787c8d3a47a50a87692c505a5d6e50df04f089bd459465d701d910ac9a03983 WatchSource:0}: Error finding container d787c8d3a47a50a87692c505a5d6e50df04f089bd459465d701d910ac9a03983: Status 404 returned error can't find the container with id d787c8d3a47a50a87692c505a5d6e50df04f089bd459465d701d910ac9a03983 Jul 07 01:01:15.606649 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:15.606628 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 01:01:15.685308 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:15.685255 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 01:01:15.700633 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:15.700603 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-147.ec2.internal\" not found" Jul 07 01:01:15.707368 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:15.707351 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 01:01:15.802654 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:15.802568 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" Jul 07 01:01:15.812599 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:15.812582 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 01:01:15.813571 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:15.813558 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-147.ec2.internal" Jul 07 01:01:15.821395 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:15.821382 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 01:01:16.362308 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.362257 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 01:01:16.381081 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.381050 2576 apiserver.go:52] "Watching apiserver" Jul 07 01:01:16.392133 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.392106 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 01:01:16.392524 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.392501 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-4f25j","kube-system/global-pull-secret-syncer-68b5t","kube-system/konnectivity-agent-sgprq","kube-system/kube-apiserver-proxy-ip-10-0-130-147.ec2.internal","openshift-cluster-node-tuning-operator/tuned-db8gg","openshift-image-registry/node-ca-r7dvk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal","openshift-network-operator/iptables-alerter-tccv2","openshift-ovn-kubernetes/ovnkube-node-88d5w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h","openshift-dns/node-resolver-blkpr","openshift-multus/multus-additional-cni-plugins-v74rp","openshift-multus/multus-t2nxr","openshift-multus/network-metrics-daemon-nq9d7"] Jul 07 01:01:16.395394 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.395361 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.397647 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.397630 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:16.397751 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:16.397714 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:16.398359 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.398320 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 01:01:16.398929 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.398590 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 01:01:16.398929 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.398631 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 01:01:16.398929 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.398630 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 01:01:16.398929 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.398782 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ggvzt\"" Jul 07 01:01:16.399962 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.399945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sgprq" Jul 07 01:01:16.402333 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.402316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:16.402444 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:16.402382 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:16.402729 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.402712 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 01:01:16.402959 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.402940 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7nfhw\"" Jul 07 01:01:16.403042 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.402983 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 01:01:16.403620 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.403603 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 01:01:16.405150 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.405132 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.408350 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.407643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r7dvk" Jul 07 01:01:16.408442 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.408354 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 01:01:16.408623 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.408590 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6n5b9\"" Jul 07 01:01:16.408623 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.408619 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 01:01:16.410298 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.410258 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:16.410411 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:16.410328 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:16.410916 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.410896 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8728w\"" Jul 07 01:01:16.411011 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.410972 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 01:01:16.411079 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.411007 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 01:01:16.411498 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.411478 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 01:01:16.414463 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.413438 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tccv2" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-modprobe-d\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-var-lib-kubelet\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97kk7\" (UniqueName: \"kubernetes.io/projected/d08fba46-79ee-41bd-8e16-4438b300962d-kube-api-access-97kk7\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415207 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-run-netns\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-multus-conf-dir\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/373ac353-db46-48b9-bb11-860c69820e52-konnectivity-ca\") pod \"konnectivity-agent-sgprq\" (UID: \"373ac353-db46-48b9-bb11-860c69820e52\") " pod="kube-system/konnectivity-agent-sgprq" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-os-release\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-run-multus-certs\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-dbus\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-systemd\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d08fba46-79ee-41bd-8e16-4438b300962d-etc-tuned\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-var-lib-kubelet\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-cnibin\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-hostroot\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-kubelet-config\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:16.415853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfkg2\" (UniqueName: \"kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2\") pod \"network-check-target-4f25j\" (UID: \"cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f\") " pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-sysctl-conf\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.415949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-etc-kubernetes\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416074 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-sysctl-d\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416099 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-sys\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416131 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d08fba46-79ee-41bd-8e16-4438b300962d-tmp\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416163 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-system-cni-dir\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-var-lib-cni-bin\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64af1a06-c664-4a18-852c-f1f048c623dd-multus-daemon-config\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/373ac353-db46-48b9-bb11-860c69820e52-agent-certs\") pod \"konnectivity-agent-sgprq\" (UID: \"373ac353-db46-48b9-bb11-860c69820e52\") " pod="kube-system/konnectivity-agent-sgprq" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416361 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-host\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416392 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsl9n\" (UniqueName: \"kubernetes.io/projected/64af1a06-c664-4a18-852c-f1f048c623dd-kube-api-access-fsl9n\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-run\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-lib-modules\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64af1a06-c664-4a18-852c-f1f048c623dd-cni-binary-copy\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.416576 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416505 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 01:01:16.417328 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.416665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-multus-socket-dir-parent\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.417328 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.417075 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nc6tv\"" Jul 07 01:01:16.417328 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.417142 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 01:01:16.419919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.417783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-var-lib-cni-multus\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.419919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.417825 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 01:01:16.419919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.417838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-sysconfig\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.419919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.417880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-kubernetes\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.419919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.417945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-multus-cni-dir\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.419919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.417974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-run-k8s-cni-cncf-io\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.419919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.418219 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.419919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.418616 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 01:01:16.420581 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.420564 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.421106 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.421087 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 01:01:16.421331 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.421310 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 01:01:16.422841 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.422821 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-blkpr" Jul 07 01:01:16.423378 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.423326 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 01:01:16.425179 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.423582 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 01:01:16.425179 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.423598 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 01:01:16.425179 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.423827 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2g4f6\"" Jul 07 01:01:16.425179 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.424038 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kdfmt\"" Jul 07 01:01:16.425179 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.424325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 01:01:16.425179 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.424575 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 01:01:16.425179 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.425010 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 01:01:16.425855 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.425217 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 01:01:16.425855 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.425527 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 01:01:16.425855 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.425614 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tqxqc\"" Jul 07 01:01:16.426041 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.425872 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 01:01:16.426041 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.425924 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.428948 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.428707 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 01:01:16.429352 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.429324 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 01:01:16.429483 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.429440 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5sb7l\"" Jul 07 01:01:16.440461 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.440436 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wx87k" Jul 07 01:01:16.450582 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.450550 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wx87k" Jul 07 01:01:16.504742 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.504712 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 01:01:16.518883 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.518853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-multus-conf-dir\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.519066 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.518899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e56f13aa-9d35-4077-b510-f68f88822098-serviceca\") pod \"node-ca-r7dvk\" (UID: \"e56f13aa-9d35-4077-b510-f68f88822098\") " pod="openshift-image-registry/node-ca-r7dvk" Jul 07 01:01:16.519066 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.518950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-log-socket\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.519066 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.518958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-multus-conf-dir\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.519066 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.518978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-run-ovn-kubernetes\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.519066 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c46837a6-f065-45a7-81e3-1ac08ae0945a-ovnkube-config\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.519066 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-socket-dir\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-registration-dir\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519116 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-device-dir\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-os-release\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-run-multus-certs\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-systemd\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519260 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b79f0a2e-3ce0-4c33-b0c5-f1e686483118-hosts-file\") pod \"node-resolver-blkpr\" (UID: \"b79f0a2e-3ce0-4c33-b0c5-f1e686483118\") " pod="openshift-dns/node-resolver-blkpr" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-os-release\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvpxd\" (UniqueName: \"kubernetes.io/projected/d2584b87-48dc-450b-98ff-dd6684dc30be-kube-api-access-vvpxd\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519317 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-run-multus-certs\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519335 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-var-lib-kubelet\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdbht\" (UniqueName: \"kubernetes.io/projected/b79f0a2e-3ce0-4c33-b0c5-f1e686483118-kube-api-access-hdbht\") pod \"node-resolver-blkpr\" (UID: \"b79f0a2e-3ce0-4c33-b0c5-f1e686483118\") " pod="openshift-dns/node-resolver-blkpr" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-etc-kubernetes\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519405 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-systemd\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-sys\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-etc-kubernetes\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-var-lib-kubelet\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d08fba46-79ee-41bd-8e16-4438b300962d-tmp\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.519570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-sys\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e56f13aa-9d35-4077-b510-f68f88822098-host\") pod \"node-ca-r7dvk\" (UID: \"e56f13aa-9d35-4077-b510-f68f88822098\") " pod="openshift-image-registry/node-ca-r7dvk" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b79f0a2e-3ce0-4c33-b0c5-f1e686483118-tmp-dir\") pod \"node-resolver-blkpr\" (UID: \"b79f0a2e-3ce0-4c33-b0c5-f1e686483118\") " pod="openshift-dns/node-resolver-blkpr" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-system-cni-dir\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64af1a06-c664-4a18-852c-f1f048c623dd-multus-daemon-config\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-systemd-units\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519656 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-system-cni-dir\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t4vd\" (UniqueName: \"kubernetes.io/projected/ccb5b1b7-790f-47a0-8989-2137a06d173d-kube-api-access-4t4vd\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsl9n\" (UniqueName: \"kubernetes.io/projected/64af1a06-c664-4a18-852c-f1f048c623dd-kube-api-access-fsl9n\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-run\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-run-openvswitch\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-cni-netd\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519786 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8t4h\" (UniqueName: \"kubernetes.io/projected/c46837a6-f065-45a7-81e3-1ac08ae0945a-kube-api-access-q8t4h\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-sys-fs\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-run\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.520509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.519974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2584b87-48dc-450b-98ff-dd6684dc30be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-var-lib-cni-multus\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-run-netns\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nzp6\" (UniqueName: \"kubernetes.io/projected/9408f9b3-b086-4745-81ec-a2398c8f2454-kube-api-access-5nzp6\") pod \"iptables-alerter-tccv2\" (UID: \"9408f9b3-b086-4745-81ec-a2398c8f2454\") " pod="openshift-network-operator/iptables-alerter-tccv2" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-run-k8s-cni-cncf-io\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-modprobe-d\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520338 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-run-k8s-cni-cncf-io\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520336 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64af1a06-c664-4a18-852c-f1f048c623dd-multus-daemon-config\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520395 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-modprobe-d\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-var-lib-openvswitch\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-var-lib-cni-multus\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9408f9b3-b086-4745-81ec-a2398c8f2454-iptables-alerter-script\") pod \"iptables-alerter-tccv2\" (UID: \"9408f9b3-b086-4745-81ec-a2398c8f2454\") " pod="openshift-network-operator/iptables-alerter-tccv2" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-run-netns\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/373ac353-db46-48b9-bb11-860c69820e52-konnectivity-ca\") pod \"konnectivity-agent-sgprq\" (UID: \"373ac353-db46-48b9-bb11-860c69820e52\") " pod="kube-system/konnectivity-agent-sgprq" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-slash\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.521158 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-run-systemd\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520743 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-run-netns\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-node-log\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c46837a6-f065-45a7-81e3-1ac08ae0945a-ovn-node-metrics-cert\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-dbus\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d08fba46-79ee-41bd-8e16-4438b300962d-etc-tuned\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-cnibin\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-hostroot\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.520989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-hostroot\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521015 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-kubelet-config\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfkg2\" (UniqueName: \"kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2\") pod \"network-check-target-4f25j\" (UID: \"cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f\") " pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-sysctl-conf\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gdg5\" (UniqueName: \"kubernetes.io/projected/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-kube-api-access-6gdg5\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-sysctl-d\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-etc-openvswitch\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-var-lib-cni-bin\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.522099 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/373ac353-db46-48b9-bb11-860c69820e52-agent-certs\") pod \"konnectivity-agent-sgprq\" (UID: \"373ac353-db46-48b9-bb11-860c69820e52\") " pod="kube-system/konnectivity-agent-sgprq" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-dbus\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521249 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/373ac353-db46-48b9-bb11-860c69820e52-konnectivity-ca\") pod \"konnectivity-agent-sgprq\" (UID: \"373ac353-db46-48b9-bb11-860c69820e52\") " pod="kube-system/konnectivity-agent-sgprq" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521369 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-kubelet-config\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521401 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-sysctl-conf\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-host\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521475 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-host-var-lib-cni-bin\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521510 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-cnibin\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9408f9b3-b086-4745-81ec-a2398c8f2454-host-slash\") pod \"iptables-alerter-tccv2\" (UID: \"9408f9b3-b086-4745-81ec-a2398c8f2454\") " pod="openshift-network-operator/iptables-alerter-tccv2" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2584b87-48dc-450b-98ff-dd6684dc30be-cnibin\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521480 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-sysctl-d\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521565 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-host\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2584b87-48dc-450b-98ff-dd6684dc30be-os-release\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2584b87-48dc-450b-98ff-dd6684dc30be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-lib-modules\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-run-ovn\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:16.521762 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:16.522939 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c46837a6-f065-45a7-81e3-1ac08ae0945a-env-overrides\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2584b87-48dc-450b-98ff-dd6684dc30be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521831 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-lib-modules\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:16.521876 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret podName:65d3c830-6ebf-4887-afe4-3ecb1691bb6d nodeName:}" failed. No retries permitted until 2026-07-07 01:01:17.021853184 +0000 UTC m=+3.028259962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret") pod "global-pull-secret-syncer-68b5t" (UID: "65d3c830-6ebf-4887-afe4-3ecb1691bb6d") : object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64af1a06-c664-4a18-852c-f1f048c623dd-cni-binary-copy\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-multus-socket-dir-parent\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-sysconfig\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.521980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-kubernetes\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-kubelet\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-cni-bin\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c46837a6-f065-45a7-81e3-1ac08ae0945a-ovnkube-script-lib\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-sysconfig\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522139 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-etc-kubernetes\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2584b87-48dc-450b-98ff-dd6684dc30be-system-cni-dir\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-multus-cni-dir\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-multus-socket-dir-parent\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.523873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-var-lib-kubelet\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.524691 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522286 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64af1a06-c664-4a18-852c-f1f048c623dd-multus-cni-dir\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.524691 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97kk7\" (UniqueName: \"kubernetes.io/projected/d08fba46-79ee-41bd-8e16-4438b300962d-kube-api-access-97kk7\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.524691 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l28lv\" (UniqueName: \"kubernetes.io/projected/e56f13aa-9d35-4077-b510-f68f88822098-kube-api-access-l28lv\") pod \"node-ca-r7dvk\" (UID: \"e56f13aa-9d35-4077-b510-f68f88822098\") " pod="openshift-image-registry/node-ca-r7dvk" Jul 07 01:01:16.524691 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64af1a06-c664-4a18-852c-f1f048c623dd-cni-binary-copy\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.524691 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2584b87-48dc-450b-98ff-dd6684dc30be-cni-binary-copy\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.525094 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.522912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d08fba46-79ee-41bd-8e16-4438b300962d-var-lib-kubelet\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.525242 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.525222 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/373ac353-db46-48b9-bb11-860c69820e52-agent-certs\") pod \"konnectivity-agent-sgprq\" (UID: \"373ac353-db46-48b9-bb11-860c69820e52\") " pod="kube-system/konnectivity-agent-sgprq" Jul 07 01:01:16.525405 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.525375 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d08fba46-79ee-41bd-8e16-4438b300962d-etc-tuned\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.525534 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.525413 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d08fba46-79ee-41bd-8e16-4438b300962d-tmp\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.527664 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:16.526990 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 01:01:16.527664 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:16.527014 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 01:01:16.527664 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:16.527029 2576 projected.go:196] Error preparing data for projected volume kube-api-access-sfkg2 for pod openshift-network-diagnostics/network-check-target-4f25j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:16.527664 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:16.527106 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2 podName:cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f nodeName:}" failed. No retries permitted until 2026-07-07 01:01:17.027086012 +0000 UTC m=+3.033492793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sfkg2" (UniqueName: "kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2") pod "network-check-target-4f25j" (UID: "cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:16.528610 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.528537 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsl9n\" (UniqueName: \"kubernetes.io/projected/64af1a06-c664-4a18-852c-f1f048c623dd-kube-api-access-fsl9n\") pod \"multus-t2nxr\" (UID: \"64af1a06-c664-4a18-852c-f1f048c623dd\") " pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.533645 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.533622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97kk7\" (UniqueName: \"kubernetes.io/projected/d08fba46-79ee-41bd-8e16-4438b300962d-kube-api-access-97kk7\") pod \"tuned-db8gg\" (UID: \"d08fba46-79ee-41bd-8e16-4438b300962d\") " pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.546729 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.546677 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-147.ec2.internal" event={"ID":"05558f760ed54fc5f15c38b24f368f0e","Type":"ContainerStarted","Data":"45cd16e0951e749004d2b47f2f418bd2bb965910c518b196601567e334da8eb0"} Jul 07 01:01:16.547922 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.547899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" event={"ID":"4b72bcb08528402effabea26e9d8f58b","Type":"ContainerStarted","Data":"d787c8d3a47a50a87692c505a5d6e50df04f089bd459465d701d910ac9a03983"} Jul 07 01:01:16.561551 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.561528 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 01:01:16.625698 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.625698 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9408f9b3-b086-4745-81ec-a2398c8f2454-host-slash\") pod \"iptables-alerter-tccv2\" (UID: \"9408f9b3-b086-4745-81ec-a2398c8f2454\") " pod="openshift-network-operator/iptables-alerter-tccv2" Jul 07 01:01:16.625981 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2584b87-48dc-450b-98ff-dd6684dc30be-cnibin\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.625981 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2584b87-48dc-450b-98ff-dd6684dc30be-os-release\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.625981 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625783 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2584b87-48dc-450b-98ff-dd6684dc30be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.625981 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625803 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9408f9b3-b086-4745-81ec-a2398c8f2454-host-slash\") pod \"iptables-alerter-tccv2\" (UID: \"9408f9b3-b086-4745-81ec-a2398c8f2454\") " pod="openshift-network-operator/iptables-alerter-tccv2" Jul 07 01:01:16.625981 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-run-ovn\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.625981 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625852 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-run-ovn\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.625981 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.625981 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2584b87-48dc-450b-98ff-dd6684dc30be-os-release\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.625981 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c46837a6-f065-45a7-81e3-1ac08ae0945a-env-overrides\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.625981 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625818 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2584b87-48dc-450b-98ff-dd6684dc30be-cnibin\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.625930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2584b87-48dc-450b-98ff-dd6684dc30be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2584b87-48dc-450b-98ff-dd6684dc30be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-kubelet\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-cni-bin\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c46837a6-f065-45a7-81e3-1ac08ae0945a-ovnkube-script-lib\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2584b87-48dc-450b-98ff-dd6684dc30be-system-cni-dir\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-kubelet\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l28lv\" (UniqueName: \"kubernetes.io/projected/e56f13aa-9d35-4077-b510-f68f88822098-kube-api-access-l28lv\") pod \"node-ca-r7dvk\" (UID: \"e56f13aa-9d35-4077-b510-f68f88822098\") " pod="openshift-image-registry/node-ca-r7dvk" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626164 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-cni-bin\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2584b87-48dc-450b-98ff-dd6684dc30be-cni-binary-copy\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e56f13aa-9d35-4077-b510-f68f88822098-serviceca\") pod \"node-ca-r7dvk\" (UID: \"e56f13aa-9d35-4077-b510-f68f88822098\") " pod="openshift-image-registry/node-ca-r7dvk" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-log-socket\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-run-ovn-kubernetes\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c46837a6-f065-45a7-81e3-1ac08ae0945a-ovnkube-config\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-socket-dir\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-registration-dir\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.626516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626462 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-device-dir\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626460 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c46837a6-f065-45a7-81e3-1ac08ae0945a-env-overrides\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b79f0a2e-3ce0-4c33-b0c5-f1e686483118-hosts-file\") pod \"node-resolver-blkpr\" (UID: \"b79f0a2e-3ce0-4c33-b0c5-f1e686483118\") " pod="openshift-dns/node-resolver-blkpr" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2584b87-48dc-450b-98ff-dd6684dc30be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626552 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2584b87-48dc-450b-98ff-dd6684dc30be-system-cni-dir\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626553 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-log-socket\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvpxd\" (UniqueName: \"kubernetes.io/projected/d2584b87-48dc-450b-98ff-dd6684dc30be-kube-api-access-vvpxd\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b79f0a2e-3ce0-4c33-b0c5-f1e686483118-hosts-file\") pod \"node-resolver-blkpr\" (UID: \"b79f0a2e-3ce0-4c33-b0c5-f1e686483118\") " pod="openshift-dns/node-resolver-blkpr" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdbht\" (UniqueName: \"kubernetes.io/projected/b79f0a2e-3ce0-4c33-b0c5-f1e686483118-kube-api-access-hdbht\") pod \"node-resolver-blkpr\" (UID: \"b79f0a2e-3ce0-4c33-b0c5-f1e686483118\") " pod="openshift-dns/node-resolver-blkpr" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626708 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-registration-dir\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626748 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-run-ovn-kubernetes\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626782 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2584b87-48dc-450b-98ff-dd6684dc30be-cni-binary-copy\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626802 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c46837a6-f065-45a7-81e3-1ac08ae0945a-ovnkube-script-lib\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e56f13aa-9d35-4077-b510-f68f88822098-host\") pod \"node-ca-r7dvk\" (UID: \"e56f13aa-9d35-4077-b510-f68f88822098\") " pod="openshift-image-registry/node-ca-r7dvk" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b79f0a2e-3ce0-4c33-b0c5-f1e686483118-tmp-dir\") pod \"node-resolver-blkpr\" (UID: \"b79f0a2e-3ce0-4c33-b0c5-f1e686483118\") " pod="openshift-dns/node-resolver-blkpr" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626908 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e56f13aa-9d35-4077-b510-f68f88822098-serviceca\") pod \"node-ca-r7dvk\" (UID: \"e56f13aa-9d35-4077-b510-f68f88822098\") " pod="openshift-image-registry/node-ca-r7dvk" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626909 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e56f13aa-9d35-4077-b510-f68f88822098-host\") pod \"node-ca-r7dvk\" (UID: \"e56f13aa-9d35-4077-b510-f68f88822098\") " pod="openshift-image-registry/node-ca-r7dvk" Jul 07 01:01:16.627419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626923 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-device-dir\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626925 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-socket-dir\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.626962 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c46837a6-f065-45a7-81e3-1ac08ae0945a-ovnkube-config\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-systemd-units\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t4vd\" (UniqueName: \"kubernetes.io/projected/ccb5b1b7-790f-47a0-8989-2137a06d173d-kube-api-access-4t4vd\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-systemd-units\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b79f0a2e-3ce0-4c33-b0c5-f1e686483118-tmp-dir\") pod \"node-resolver-blkpr\" (UID: \"b79f0a2e-3ce0-4c33-b0c5-f1e686483118\") " pod="openshift-dns/node-resolver-blkpr" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-run-openvswitch\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-cni-netd\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8t4h\" (UniqueName: \"kubernetes.io/projected/c46837a6-f065-45a7-81e3-1ac08ae0945a-kube-api-access-q8t4h\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-sys-fs\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627359 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-cni-netd\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2584b87-48dc-450b-98ff-dd6684dc30be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627414 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-run-openvswitch\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-run-netns\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.628384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627476 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nzp6\" (UniqueName: \"kubernetes.io/projected/9408f9b3-b086-4745-81ec-a2398c8f2454-kube-api-access-5nzp6\") pod \"iptables-alerter-tccv2\" (UID: \"9408f9b3-b086-4745-81ec-a2398c8f2454\") " pod="openshift-network-operator/iptables-alerter-tccv2" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-var-lib-openvswitch\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9408f9b3-b086-4745-81ec-a2398c8f2454-iptables-alerter-script\") pod \"iptables-alerter-tccv2\" (UID: \"9408f9b3-b086-4745-81ec-a2398c8f2454\") " pod="openshift-network-operator/iptables-alerter-tccv2" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-slash\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-run-systemd\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-node-log\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627640 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-sys-fs\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c46837a6-f065-45a7-81e3-1ac08ae0945a-ovn-node-metrics-cert\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gdg5\" (UniqueName: \"kubernetes.io/projected/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-kube-api-access-6gdg5\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-etc-openvswitch\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627834 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-etc-openvswitch\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.627965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2584b87-48dc-450b-98ff-dd6684dc30be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.628005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-run-netns\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.628033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.628061 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-host-slash\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.629433 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.628087 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-var-lib-openvswitch\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.630399 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.628108 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-run-systemd\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.630399 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:16.628156 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:16.630399 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.628171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c46837a6-f065-45a7-81e3-1ac08ae0945a-node-log\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.630399 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:16.628208 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs podName:ccb5b1b7-790f-47a0-8989-2137a06d173d nodeName:}" failed. No retries permitted until 2026-07-07 01:01:17.128194497 +0000 UTC m=+3.134601258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs") pod "network-metrics-daemon-nq9d7" (UID: "ccb5b1b7-790f-47a0-8989-2137a06d173d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:16.630399 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.628794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9408f9b3-b086-4745-81ec-a2398c8f2454-iptables-alerter-script\") pod \"iptables-alerter-tccv2\" (UID: \"9408f9b3-b086-4745-81ec-a2398c8f2454\") " pod="openshift-network-operator/iptables-alerter-tccv2" Jul 07 01:01:16.631300 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.631276 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c46837a6-f065-45a7-81e3-1ac08ae0945a-ovn-node-metrics-cert\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.636807 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.636786 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvpxd\" (UniqueName: \"kubernetes.io/projected/d2584b87-48dc-450b-98ff-dd6684dc30be-kube-api-access-vvpxd\") pod \"multus-additional-cni-plugins-v74rp\" (UID: \"d2584b87-48dc-450b-98ff-dd6684dc30be\") " pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:16.637015 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.636989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l28lv\" (UniqueName: \"kubernetes.io/projected/e56f13aa-9d35-4077-b510-f68f88822098-kube-api-access-l28lv\") pod \"node-ca-r7dvk\" (UID: \"e56f13aa-9d35-4077-b510-f68f88822098\") " pod="openshift-image-registry/node-ca-r7dvk" Jul 07 01:01:16.637257 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.637229 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdbht\" (UniqueName: \"kubernetes.io/projected/b79f0a2e-3ce0-4c33-b0c5-f1e686483118-kube-api-access-hdbht\") pod \"node-resolver-blkpr\" (UID: \"b79f0a2e-3ce0-4c33-b0c5-f1e686483118\") " pod="openshift-dns/node-resolver-blkpr" Jul 07 01:01:16.638029 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.638008 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t4vd\" (UniqueName: \"kubernetes.io/projected/ccb5b1b7-790f-47a0-8989-2137a06d173d-kube-api-access-4t4vd\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:16.638123 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.638065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nzp6\" (UniqueName: \"kubernetes.io/projected/9408f9b3-b086-4745-81ec-a2398c8f2454-kube-api-access-5nzp6\") pod \"iptables-alerter-tccv2\" (UID: \"9408f9b3-b086-4745-81ec-a2398c8f2454\") " pod="openshift-network-operator/iptables-alerter-tccv2" Jul 07 01:01:16.638203 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.638178 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8t4h\" (UniqueName: \"kubernetes.io/projected/c46837a6-f065-45a7-81e3-1ac08ae0945a-kube-api-access-q8t4h\") pod \"ovnkube-node-88d5w\" (UID: \"c46837a6-f065-45a7-81e3-1ac08ae0945a\") " pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.639518 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.639494 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gdg5\" (UniqueName: \"kubernetes.io/projected/1706ac71-bd0c-4aef-a5a8-201cbefb62e5-kube-api-access-6gdg5\") pod \"aws-ebs-csi-driver-node-w874h\" (UID: \"1706ac71-bd0c-4aef-a5a8-201cbefb62e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.709681 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.709636 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t2nxr" Jul 07 01:01:16.721067 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.721039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sgprq" Jul 07 01:01:16.729547 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.729522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-db8gg" Jul 07 01:01:16.737520 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.737495 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r7dvk" Jul 07 01:01:16.754527 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.754491 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tccv2" Jul 07 01:01:16.759533 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.759513 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:16.766625 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.766604 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" Jul 07 01:01:16.774491 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.774472 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-blkpr" Jul 07 01:01:16.781540 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:16.781486 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v74rp" Jul 07 01:01:17.032671 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:17.032561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:17.032671 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:17.032624 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfkg2\" (UniqueName: \"kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2\") pod \"network-check-target-4f25j\" (UID: \"cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f\") " pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:17.032919 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:17.032705 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:17.032919 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:17.032776 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 01:01:17.032919 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:17.032791 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret podName:65d3c830-6ebf-4887-afe4-3ecb1691bb6d nodeName:}" failed. No retries permitted until 2026-07-07 01:01:18.03276737 +0000 UTC m=+4.039174159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret") pod "global-pull-secret-syncer-68b5t" (UID: "65d3c830-6ebf-4887-afe4-3ecb1691bb6d") : object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:17.032919 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:17.032793 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 01:01:17.032919 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:17.032814 2576 projected.go:196] Error preparing data for projected volume kube-api-access-sfkg2 for pod openshift-network-diagnostics/network-check-target-4f25j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:17.032919 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:17.032882 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2 podName:cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f nodeName:}" failed. No retries permitted until 2026-07-07 01:01:18.032864506 +0000 UTC m=+4.039271274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sfkg2" (UniqueName: "kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2") pod "network-check-target-4f25j" (UID: "cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:17.133656 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:17.133611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:17.133871 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:17.133763 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:17.133871 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:17.133854 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs podName:ccb5b1b7-790f-47a0-8989-2137a06d173d nodeName:}" failed. No retries permitted until 2026-07-07 01:01:18.133829603 +0000 UTC m=+4.140236384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs") pod "network-metrics-daemon-nq9d7" (UID: "ccb5b1b7-790f-47a0-8989-2137a06d173d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:17.454085 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:17.453960 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 00:56:17 +0000 UTC" deadline="2028-02-13 03:36:30.897468461 +0000 UTC" Jul 07 01:01:17.454085 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:17.454036 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14066h35m13.443436502s" Jul 07 01:01:17.596051 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:17.596019 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode56f13aa_9d35_4077_b510_f68f88822098.slice/crio-2c7170ef7f7ca852712020c4812d5874582b73776a197fa63d0fd2242c9033b6 WatchSource:0}: Error finding container 2c7170ef7f7ca852712020c4812d5874582b73776a197fa63d0fd2242c9033b6: Status 404 returned error can't find the container with id 2c7170ef7f7ca852712020c4812d5874582b73776a197fa63d0fd2242c9033b6 Jul 07 01:01:17.597297 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:17.597243 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1706ac71_bd0c_4aef_a5a8_201cbefb62e5.slice/crio-69b7f2e83ea1bbe2f4767c95361acc29fd2fad224f37c972eb715a8518ba2f66 WatchSource:0}: Error finding container 69b7f2e83ea1bbe2f4767c95361acc29fd2fad224f37c972eb715a8518ba2f66: Status 404 returned error can't find the container with id 69b7f2e83ea1bbe2f4767c95361acc29fd2fad224f37c972eb715a8518ba2f66 Jul 07 01:01:17.598087 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:17.598062 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9408f9b3_b086_4745_81ec_a2398c8f2454.slice/crio-ee89dbb5f320b54ddd78ec456de678a4a5ec2b7b3f2af665f7b093e33888c6c7 WatchSource:0}: Error finding container ee89dbb5f320b54ddd78ec456de678a4a5ec2b7b3f2af665f7b093e33888c6c7: Status 404 returned error can't find the container with id ee89dbb5f320b54ddd78ec456de678a4a5ec2b7b3f2af665f7b093e33888c6c7 Jul 07 01:01:17.602462 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:17.602442 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64af1a06_c664_4a18_852c_f1f048c623dd.slice/crio-84f9d2f0a3aa9eef19e408390f8cda5d5fbb3a8a4d43f11fbc0a05bcfbeccb8f WatchSource:0}: Error finding container 84f9d2f0a3aa9eef19e408390f8cda5d5fbb3a8a4d43f11fbc0a05bcfbeccb8f: Status 404 returned error can't find the container with id 84f9d2f0a3aa9eef19e408390f8cda5d5fbb3a8a4d43f11fbc0a05bcfbeccb8f Jul 07 01:01:17.606160 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:17.603885 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373ac353_db46_48b9_bb11_860c69820e52.slice/crio-fb19e2e08d8d1232e0bfa3f2b5bef092f79016175a45123ed9044f5c4359ecd6 WatchSource:0}: Error finding container fb19e2e08d8d1232e0bfa3f2b5bef092f79016175a45123ed9044f5c4359ecd6: Status 404 returned error can't find the container with id fb19e2e08d8d1232e0bfa3f2b5bef092f79016175a45123ed9044f5c4359ecd6 Jul 07 01:01:17.606160 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:17.605473 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08fba46_79ee_41bd_8e16_4438b300962d.slice/crio-d73dc07f42d25ba92cd1b40a3c44eec3053ca60f1f3a449892f59b84ad4a2070 WatchSource:0}: Error finding container d73dc07f42d25ba92cd1b40a3c44eec3053ca60f1f3a449892f59b84ad4a2070: Status 404 returned error can't find the container with id d73dc07f42d25ba92cd1b40a3c44eec3053ca60f1f3a449892f59b84ad4a2070 Jul 07 01:01:17.606850 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:17.606784 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79f0a2e_3ce0_4c33_b0c5_f1e686483118.slice/crio-013c29f63b13701d59468a075023667d37f9fe3ca52a3b8af6bda815a3c6c190 WatchSource:0}: Error finding container 013c29f63b13701d59468a075023667d37f9fe3ca52a3b8af6bda815a3c6c190: Status 404 returned error can't find the container with id 013c29f63b13701d59468a075023667d37f9fe3ca52a3b8af6bda815a3c6c190 Jul 07 01:01:17.607019 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:17.606997 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2584b87_48dc_450b_98ff_dd6684dc30be.slice/crio-3ebc151d97cef402e46715d19b4ae8099fc13fcb5581c98fb9c611c2e34c180b WatchSource:0}: Error finding container 3ebc151d97cef402e46715d19b4ae8099fc13fcb5581c98fb9c611c2e34c180b: Status 404 returned error can't find the container with id 3ebc151d97cef402e46715d19b4ae8099fc13fcb5581c98fb9c611c2e34c180b Jul 07 01:01:17.608827 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:01:17.608803 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46837a6_f065_45a7_81e3_1ac08ae0945a.slice/crio-94a5bb0bc4f5da68db0b28f74abdcb40bc259135f24692abb494632c275b9619 WatchSource:0}: Error finding container 94a5bb0bc4f5da68db0b28f74abdcb40bc259135f24692abb494632c275b9619: Status 404 returned error can't find the container with id 94a5bb0bc4f5da68db0b28f74abdcb40bc259135f24692abb494632c275b9619 Jul 07 01:01:18.041895 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.041616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:18.042086 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.041921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfkg2\" (UniqueName: \"kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2\") pod \"network-check-target-4f25j\" (UID: \"cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f\") " pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:18.042086 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:18.041817 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:18.042086 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:18.042066 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret podName:65d3c830-6ebf-4887-afe4-3ecb1691bb6d nodeName:}" failed. No retries permitted until 2026-07-07 01:01:20.042036505 +0000 UTC m=+6.048443271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret") pod "global-pull-secret-syncer-68b5t" (UID: "65d3c830-6ebf-4887-afe4-3ecb1691bb6d") : object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:18.042264 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:18.042092 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 01:01:18.042264 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:18.042113 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 01:01:18.042264 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:18.042127 2576 projected.go:196] Error preparing data for projected volume kube-api-access-sfkg2 for pod openshift-network-diagnostics/network-check-target-4f25j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:18.042264 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:18.042179 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2 podName:cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f nodeName:}" failed. No retries permitted until 2026-07-07 01:01:20.042162452 +0000 UTC m=+6.048569216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sfkg2" (UniqueName: "kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2") pod "network-check-target-4f25j" (UID: "cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:18.142560 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.142432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:18.142733 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:18.142666 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:18.142802 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:18.142736 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs podName:ccb5b1b7-790f-47a0-8989-2137a06d173d nodeName:}" failed. No retries permitted until 2026-07-07 01:01:20.14271735 +0000 UTC m=+6.149124119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs") pod "network-metrics-daemon-nq9d7" (UID: "ccb5b1b7-790f-47a0-8989-2137a06d173d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:18.454977 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.454887 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 00:56:17 +0000 UTC" deadline="2028-03-06 18:06:46.676066677 +0000 UTC" Jul 07 01:01:18.454977 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.454929 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14609h5m28.221142018s" Jul 07 01:01:18.545033 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.544472 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:18.545033 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:18.544627 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:18.545033 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.544677 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:18.545033 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.544758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:18.545033 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:18.544871 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:18.545033 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:18.544959 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:18.558152 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.558103 2576 generic.go:356] "Generic (PLEG): container finished" podID="4b72bcb08528402effabea26e9d8f58b" containerID="5429b592d67a44a49f8126e3fec5a56ccc003b7a78ca12e5b81cbce6981427b5" exitCode=0 Jul 07 01:01:18.558359 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.558188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" event={"ID":"4b72bcb08528402effabea26e9d8f58b","Type":"ContainerDied","Data":"5429b592d67a44a49f8126e3fec5a56ccc003b7a78ca12e5b81cbce6981427b5"} Jul 07 01:01:18.571008 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.570976 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-db8gg" event={"ID":"d08fba46-79ee-41bd-8e16-4438b300962d","Type":"ContainerStarted","Data":"d73dc07f42d25ba92cd1b40a3c44eec3053ca60f1f3a449892f59b84ad4a2070"} Jul 07 01:01:18.583514 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.583384 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t2nxr" event={"ID":"64af1a06-c664-4a18-852c-f1f048c623dd","Type":"ContainerStarted","Data":"84f9d2f0a3aa9eef19e408390f8cda5d5fbb3a8a4d43f11fbc0a05bcfbeccb8f"} Jul 07 01:01:18.603197 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.603093 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tccv2" event={"ID":"9408f9b3-b086-4745-81ec-a2398c8f2454","Type":"ContainerStarted","Data":"ee89dbb5f320b54ddd78ec456de678a4a5ec2b7b3f2af665f7b093e33888c6c7"} Jul 07 01:01:18.606775 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.606737 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" event={"ID":"1706ac71-bd0c-4aef-a5a8-201cbefb62e5","Type":"ContainerStarted","Data":"69b7f2e83ea1bbe2f4767c95361acc29fd2fad224f37c972eb715a8518ba2f66"} Jul 07 01:01:18.609411 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.609379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r7dvk" event={"ID":"e56f13aa-9d35-4077-b510-f68f88822098","Type":"ContainerStarted","Data":"2c7170ef7f7ca852712020c4812d5874582b73776a197fa63d0fd2242c9033b6"} Jul 07 01:01:18.616498 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.616467 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" event={"ID":"c46837a6-f065-45a7-81e3-1ac08ae0945a","Type":"ContainerStarted","Data":"94a5bb0bc4f5da68db0b28f74abdcb40bc259135f24692abb494632c275b9619"} Jul 07 01:01:18.637355 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.637302 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v74rp" event={"ID":"d2584b87-48dc-450b-98ff-dd6684dc30be","Type":"ContainerStarted","Data":"3ebc151d97cef402e46715d19b4ae8099fc13fcb5581c98fb9c611c2e34c180b"} Jul 07 01:01:18.642289 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.642257 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-blkpr" event={"ID":"b79f0a2e-3ce0-4c33-b0c5-f1e686483118","Type":"ContainerStarted","Data":"013c29f63b13701d59468a075023667d37f9fe3ca52a3b8af6bda815a3c6c190"} Jul 07 01:01:18.657547 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.657512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sgprq" event={"ID":"373ac353-db46-48b9-bb11-860c69820e52","Type":"ContainerStarted","Data":"fb19e2e08d8d1232e0bfa3f2b5bef092f79016175a45123ed9044f5c4359ecd6"} Jul 07 01:01:18.672803 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:18.672772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-147.ec2.internal" event={"ID":"05558f760ed54fc5f15c38b24f368f0e","Type":"ContainerStarted","Data":"cfcbc252aff606125a515276a709b216f1a6f8dad574e773975dda03c96e82bc"} Jul 07 01:01:19.689097 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:19.689001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" event={"ID":"4b72bcb08528402effabea26e9d8f58b","Type":"ContainerStarted","Data":"bcd7754151298c1ff099c7a76071461211957111a9b38904a8cd9fb6a6d6a762"} Jul 07 01:01:19.707287 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:19.707198 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-147.ec2.internal" podStartSLOduration=3.707174087 podStartE2EDuration="3.707174087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:01:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:01:18.69226526 +0000 UTC m=+4.698672048" watchObservedRunningTime="2026-07-07 01:01:19.707174087 +0000 UTC m=+5.713580874" Jul 07 01:01:20.060444 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:20.060352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:20.060444 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:20.060406 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfkg2\" (UniqueName: \"kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2\") pod \"network-check-target-4f25j\" (UID: \"cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f\") " pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:20.060682 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:20.060557 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 01:01:20.060682 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:20.060576 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 01:01:20.060682 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:20.060591 2576 projected.go:196] Error preparing data for projected volume kube-api-access-sfkg2 for pod openshift-network-diagnostics/network-check-target-4f25j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:20.060682 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:20.060645 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2 podName:cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f nodeName:}" failed. No retries permitted until 2026-07-07 01:01:24.060627581 +0000 UTC m=+10.067034346 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sfkg2" (UniqueName: "kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2") pod "network-check-target-4f25j" (UID: "cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:20.061057 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:20.061036 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:20.061132 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:20.061094 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret podName:65d3c830-6ebf-4887-afe4-3ecb1691bb6d nodeName:}" failed. No retries permitted until 2026-07-07 01:01:24.061078385 +0000 UTC m=+10.067485154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret") pod "global-pull-secret-syncer-68b5t" (UID: "65d3c830-6ebf-4887-afe4-3ecb1691bb6d") : object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:20.162293 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:20.161734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:20.162293 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:20.161878 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:20.162293 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:20.161940 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs podName:ccb5b1b7-790f-47a0-8989-2137a06d173d nodeName:}" failed. No retries permitted until 2026-07-07 01:01:24.16192126 +0000 UTC m=+10.168328029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs") pod "network-metrics-daemon-nq9d7" (UID: "ccb5b1b7-790f-47a0-8989-2137a06d173d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:20.543548 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:20.543461 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:20.543725 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:20.543604 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:20.544059 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:20.544037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:20.544201 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:20.544178 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:20.550060 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:20.546147 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:20.550060 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:20.546246 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:22.543462 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:22.543428 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:22.543462 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:22.543447 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:22.544029 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:22.543547 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:22.544029 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:22.543639 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:22.544029 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:22.543757 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:22.544029 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:22.543850 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:24.093707 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:24.093666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:24.094173 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:24.093719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfkg2\" (UniqueName: \"kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2\") pod \"network-check-target-4f25j\" (UID: \"cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f\") " pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:24.094173 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:24.093844 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:24.094173 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:24.093925 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret podName:65d3c830-6ebf-4887-afe4-3ecb1691bb6d nodeName:}" failed. No retries permitted until 2026-07-07 01:01:32.093902898 +0000 UTC m=+18.100309681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret") pod "global-pull-secret-syncer-68b5t" (UID: "65d3c830-6ebf-4887-afe4-3ecb1691bb6d") : object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:24.094173 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:24.093928 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 01:01:24.094173 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:24.093948 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 01:01:24.094173 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:24.093963 2576 projected.go:196] Error preparing data for projected volume kube-api-access-sfkg2 for pod openshift-network-diagnostics/network-check-target-4f25j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:24.094173 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:24.094014 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2 podName:cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f nodeName:}" failed. No retries permitted until 2026-07-07 01:01:32.093996742 +0000 UTC m=+18.100403509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sfkg2" (UniqueName: "kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2") pod "network-check-target-4f25j" (UID: "cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:24.194821 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:24.194782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:24.195007 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:24.194932 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:24.195007 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:24.194999 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs podName:ccb5b1b7-790f-47a0-8989-2137a06d173d nodeName:}" failed. No retries permitted until 2026-07-07 01:01:32.194977546 +0000 UTC m=+18.201384317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs") pod "network-metrics-daemon-nq9d7" (UID: "ccb5b1b7-790f-47a0-8989-2137a06d173d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:24.544071 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:24.543630 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:24.544071 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:24.543734 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:24.544071 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:24.543776 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:24.544071 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:24.543783 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:24.544071 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:24.543872 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:24.544071 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:24.543983 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:26.544380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:26.543424 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:26.544380 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:26.543563 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:26.544380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:26.544028 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:26.544380 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:26.544149 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:26.544380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:26.544222 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:26.544380 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:26.544305 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:28.543298 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:28.543254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:28.543725 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:28.543262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:28.543725 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:28.543374 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:28.543725 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:28.543385 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:28.543725 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:28.543502 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:28.543725 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:28.543598 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:30.542731 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:30.542694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:30.543228 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:30.542742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:30.543228 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:30.542694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:30.543228 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:30.542827 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:30.543228 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:30.542908 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:30.543228 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:30.543020 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:32.159076 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:32.159036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:32.159076 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:32.159074 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfkg2\" (UniqueName: \"kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2\") pod \"network-check-target-4f25j\" (UID: \"cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f\") " pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:32.159758 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:32.159205 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 01:01:32.159758 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:32.159206 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:32.159758 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:32.159228 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 01:01:32.159758 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:32.159243 2576 projected.go:196] Error preparing data for projected volume kube-api-access-sfkg2 for pod openshift-network-diagnostics/network-check-target-4f25j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:32.159758 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:32.159299 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret podName:65d3c830-6ebf-4887-afe4-3ecb1691bb6d nodeName:}" failed. No retries permitted until 2026-07-07 01:01:48.159280391 +0000 UTC m=+34.165687151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret") pod "global-pull-secret-syncer-68b5t" (UID: "65d3c830-6ebf-4887-afe4-3ecb1691bb6d") : object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:32.159758 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:32.159314 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2 podName:cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f nodeName:}" failed. No retries permitted until 2026-07-07 01:01:48.159308112 +0000 UTC m=+34.165714873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sfkg2" (UniqueName: "kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2") pod "network-check-target-4f25j" (UID: "cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:32.260252 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:32.260201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:32.260449 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:32.260344 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:32.260449 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:32.260409 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs podName:ccb5b1b7-790f-47a0-8989-2137a06d173d nodeName:}" failed. No retries permitted until 2026-07-07 01:01:48.260391009 +0000 UTC m=+34.266797773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs") pod "network-metrics-daemon-nq9d7" (UID: "ccb5b1b7-790f-47a0-8989-2137a06d173d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:32.542942 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:32.542863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:32.542942 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:32.542891 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:32.543120 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:32.542866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:32.543120 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:32.542978 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:32.543120 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:32.543046 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:32.543230 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:32.543125 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:34.545382 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:34.545349 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:34.545869 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:34.545349 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:34.545869 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:34.545474 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:34.545869 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:34.545528 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:34.545869 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:34.545346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:34.545869 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:34.545605 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:36.542711 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:36.542671 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:36.542711 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:36.542702 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:36.543221 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:36.542671 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:36.543221 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:36.542819 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:36.543221 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:36.542953 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:36.543221 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:36.543039 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:38.543344 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.542978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:38.543906 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.542978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:38.543906 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:38.543390 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:38.543906 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.543017 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:38.543906 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:38.543518 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:38.543906 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:38.543452 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:38.727583 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.727555 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t2nxr" event={"ID":"64af1a06-c664-4a18-852c-f1f048c623dd","Type":"ContainerStarted","Data":"fe82f015c48e8b4f76a021904b6ffcad7f8a1b656c7ac5a1b234b36bd8b8d2c8"} Jul 07 01:01:38.728951 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.728927 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" event={"ID":"1706ac71-bd0c-4aef-a5a8-201cbefb62e5","Type":"ContainerStarted","Data":"624e91ef84b14d4e7589f868159ad0e6055af8764f1d0520b526a397834289e5"} Jul 07 01:01:38.730204 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.730179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r7dvk" event={"ID":"e56f13aa-9d35-4077-b510-f68f88822098","Type":"ContainerStarted","Data":"9bff248c99eb847867c37878998bf9773ee58e4cf9d9a51ac866a7677669780f"} Jul 07 01:01:38.732941 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.732917 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" event={"ID":"c46837a6-f065-45a7-81e3-1ac08ae0945a","Type":"ContainerStarted","Data":"d61c88a4e0b85d590b87fa84c0224300de90b0539713ee2eb804284cde4498ff"} Jul 07 01:01:38.733041 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.732967 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" event={"ID":"c46837a6-f065-45a7-81e3-1ac08ae0945a","Type":"ContainerStarted","Data":"b01571b02547dd01582bd1f51dba5a0b865225e7e2e5908cb8ad877cab1453d5"} Jul 07 01:01:38.733041 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.733003 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" event={"ID":"c46837a6-f065-45a7-81e3-1ac08ae0945a","Type":"ContainerStarted","Data":"dee3bc125c2c11bbb65b5726da05e2bfc91eff06bb92fad9bd56015b15410f24"} Jul 07 01:01:38.733041 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.733031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" event={"ID":"c46837a6-f065-45a7-81e3-1ac08ae0945a","Type":"ContainerStarted","Data":"914475ef8bf7aa30f93c58b2a0da011e6a365b3fcd5353faf2c378c913d170b5"} Jul 07 01:01:38.733162 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.733057 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" event={"ID":"c46837a6-f065-45a7-81e3-1ac08ae0945a","Type":"ContainerStarted","Data":"eb6cb05350645a7ff8058840911812c8d277ee0bd6bf1f08a0667328bca4079b"} Jul 07 01:01:38.733162 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.733086 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" event={"ID":"c46837a6-f065-45a7-81e3-1ac08ae0945a","Type":"ContainerStarted","Data":"708a8d03d5f1b061a697f8335198365df7ba38c819e064ddbf29d48899f02b4e"} Jul 07 01:01:38.734223 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.734200 2576 generic.go:356] "Generic (PLEG): container finished" podID="d2584b87-48dc-450b-98ff-dd6684dc30be" containerID="ccb4a9b7998686679caf00dd291ed73432bf086a2649c234202315b64bd27e88" exitCode=0 Jul 07 01:01:38.734339 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.734290 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v74rp" event={"ID":"d2584b87-48dc-450b-98ff-dd6684dc30be","Type":"ContainerDied","Data":"ccb4a9b7998686679caf00dd291ed73432bf086a2649c234202315b64bd27e88"} Jul 07 01:01:38.735716 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.735686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-blkpr" event={"ID":"b79f0a2e-3ce0-4c33-b0c5-f1e686483118","Type":"ContainerStarted","Data":"c94e9345ed1bbf7657e8acc56b7f01c72b9795f0c6e3484da4eda7d7ca71ffcb"} Jul 07 01:01:38.736890 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.736874 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sgprq" event={"ID":"373ac353-db46-48b9-bb11-860c69820e52","Type":"ContainerStarted","Data":"272771afe7cb45781c7c687f32ecbc7d466de489bc80ac48e6285c0b8ceacfd7"} Jul 07 01:01:38.738196 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.738175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-db8gg" event={"ID":"d08fba46-79ee-41bd-8e16-4438b300962d","Type":"ContainerStarted","Data":"daa79a3de36852d9cb25f23670b9adfe2b10b5a5c465a38aab77b03e60ca61cb"} Jul 07 01:01:38.746366 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.744748 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t2nxr" podStartSLOduration=3.633334494 podStartE2EDuration="23.74470016s" totalImagesPullingTime="20.111365666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:01:38.744666653 +0000 UTC m=+24.751073430" watchObservedRunningTime="2026-07-07 01:01:38.74470016 +0000 UTC m=+24.751106943" Jul 07 01:01:38.746366 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.745580 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-147.ec2.internal" podStartSLOduration=22.745560169 podStartE2EDuration="22.745560169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:01:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:01:19.707626942 +0000 UTC m=+5.714033728" watchObservedRunningTime="2026-07-07 01:01:38.745560169 +0000 UTC m=+24.751966951" Jul 07 01:01:38.758367 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.758333 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r7dvk" podStartSLOduration=3.675580716 podStartE2EDuration="23.758322537s" totalImagesPullingTime="20.082741821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:01:38.7578845 +0000 UTC m=+24.764291282" watchObservedRunningTime="2026-07-07 01:01:38.758322537 +0000 UTC m=+24.764729318" Jul 07 01:01:38.772545 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.772510 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-blkpr" podStartSLOduration=3.703373019 podStartE2EDuration="23.772498561s" totalImagesPullingTime="20.069125542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:01:38.772225047 +0000 UTC m=+24.778631828" watchObservedRunningTime="2026-07-07 01:01:38.772498561 +0000 UTC m=+24.778905343" Jul 07 01:01:38.808447 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:38.808359 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sgprq" podStartSLOduration=8.807506067 podStartE2EDuration="23.808340051s" totalImagesPullingTime="15.000833984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:01:38.80782238 +0000 UTC m=+24.814229189" watchObservedRunningTime="2026-07-07 01:01:38.808340051 +0000 UTC m=+24.814746836" Jul 07 01:01:39.152067 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:39.152043 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 01:01:39.484826 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:39.484688 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T01:01:39.152061736Z","UUID":"4d0d7fb7-054e-42b4-95a9-136b7250a707","Handler":null,"Name":"","Endpoint":""} Jul 07 01:01:39.486244 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:39.486221 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 01:01:39.486384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:39.486254 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 01:01:39.742612 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:39.742514 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tccv2" event={"ID":"9408f9b3-b086-4745-81ec-a2398c8f2454","Type":"ContainerStarted","Data":"71bd1ffbd905c3d2830b9358354e7b09624705bf9ab1af1dfb157b3cfb34e527"} Jul 07 01:01:39.744681 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:39.744650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" event={"ID":"1706ac71-bd0c-4aef-a5a8-201cbefb62e5","Type":"ContainerStarted","Data":"4b2fb3ac67d05320696148e48966409165aa7cd7515a62a81ab8b8e415bbd955"} Jul 07 01:01:39.757858 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:39.757809 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-db8gg" podStartSLOduration=4.685189695 podStartE2EDuration="24.757791301s" totalImagesPullingTime="20.072601606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:01:38.828644088 +0000 UTC m=+24.835050881" watchObservedRunningTime="2026-07-07 01:01:39.757791301 +0000 UTC m=+25.764198085" Jul 07 01:01:39.758042 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:39.758016 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tccv2" podStartSLOduration=4.679072083 podStartE2EDuration="24.758008546s" totalImagesPullingTime="20.078936463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:01:39.757557243 +0000 UTC m=+25.763964026" watchObservedRunningTime="2026-07-07 01:01:39.758008546 +0000 UTC m=+25.764415328" Jul 07 01:01:40.542588 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:40.542550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:40.542648 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:40.542588 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:40.542697 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:40.542674 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:40.542843 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:40.542776 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:40.542952 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:40.542822 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:40.543078 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:40.543058 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:40.750833 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:40.750751 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" event={"ID":"c46837a6-f065-45a7-81e3-1ac08ae0945a","Type":"ContainerStarted","Data":"d094af21e3ce26ffd4f5269461270906964c71976e2c80061dac443d5ac2580e"} Jul 07 01:01:40.753063 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:40.753037 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" event={"ID":"1706ac71-bd0c-4aef-a5a8-201cbefb62e5","Type":"ContainerStarted","Data":"73b795f4833d96c8f27ef65b328d9af4b33fddeb6c5973984b64dd009334bcc7"} Jul 07 01:01:40.771634 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:40.771593 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w874h" podStartSLOduration=3.296688771 podStartE2EDuration="25.771579779s" totalImagesPullingTime="22.474891008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:01:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:01:40.771024492 +0000 UTC m=+26.777431275" watchObservedRunningTime="2026-07-07 01:01:40.771579779 +0000 UTC m=+26.777986561" Jul 07 01:01:42.498303 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:42.498105 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sgprq" Jul 07 01:01:42.498759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:42.498739 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sgprq" Jul 07 01:01:42.542608 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:42.542573 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:42.542608 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:42.542612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:42.542831 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:42.542691 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:42.542831 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:42.542750 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:42.542831 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:42.542780 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:42.542984 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:42.542866 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:42.757640 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:42.757575 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sgprq" Jul 07 01:01:42.758059 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:42.758041 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sgprq" Jul 07 01:01:43.763482 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:43.763146 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" event={"ID":"c46837a6-f065-45a7-81e3-1ac08ae0945a","Type":"ContainerStarted","Data":"baa86fb08e781346cb37b90ee9bd2a9497431157eeae57b70afebd4aad93ef08"} Jul 07 01:01:43.764190 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:43.763514 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:43.765735 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:43.765708 2576 generic.go:356] "Generic (PLEG): container finished" podID="d2584b87-48dc-450b-98ff-dd6684dc30be" containerID="fd0ee0bdf47dbaac07f93c6d3380587b902f7e0049268c0595215b97a6b147eb" exitCode=0 Jul 07 01:01:43.765848 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:43.765773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v74rp" event={"ID":"d2584b87-48dc-450b-98ff-dd6684dc30be","Type":"ContainerDied","Data":"fd0ee0bdf47dbaac07f93c6d3380587b902f7e0049268c0595215b97a6b147eb"} Jul 07 01:01:43.779636 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:43.779618 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:43.790561 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:43.790525 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" podStartSLOduration=8.64179776 podStartE2EDuration="28.790512899s" totalImagesPullingTime="20.148715139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:01:43.787556969 +0000 UTC m=+29.793963768" watchObservedRunningTime="2026-07-07 01:01:43.790512899 +0000 UTC m=+29.796919681" Jul 07 01:01:44.315669 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:44.315634 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:44.545437 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:44.545412 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:44.545647 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:44.545419 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:44.545647 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:44.545419 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:44.545740 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:44.545644 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:44.545740 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:44.545651 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:44.545740 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:44.545499 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:44.768440 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:44.768364 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:44.784424 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:44.784397 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:01:45.199796 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:45.199767 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4f25j"] Jul 07 01:01:45.199943 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:45.199868 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:45.200010 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:45.199974 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:45.202604 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:45.202582 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nq9d7"] Jul 07 01:01:45.202740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:45.202696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:45.202808 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:45.202783 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:45.203380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:45.203358 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-68b5t"] Jul 07 01:01:45.203461 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:45.203448 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:45.203558 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:45.203538 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:46.542840 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:46.542806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:46.543327 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:46.542939 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:47.542918 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:47.542753 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:47.543417 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:47.542892 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:47.543417 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:47.542994 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:47.543417 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:47.543102 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:47.777322 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:47.777222 2576 generic.go:356] "Generic (PLEG): container finished" podID="d2584b87-48dc-450b-98ff-dd6684dc30be" containerID="1ccae4ae9d6d3214dac10142fc82c724ef07465167f39f812ccefdffb5af5baa" exitCode=0 Jul 07 01:01:47.777322 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:47.777294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v74rp" event={"ID":"d2584b87-48dc-450b-98ff-dd6684dc30be","Type":"ContainerDied","Data":"1ccae4ae9d6d3214dac10142fc82c724ef07465167f39f812ccefdffb5af5baa"} Jul 07 01:01:48.177229 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:48.177154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:48.177229 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:48.177199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfkg2\" (UniqueName: \"kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2\") pod \"network-check-target-4f25j\" (UID: \"cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f\") " pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:48.177436 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:48.177347 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 01:01:48.177436 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:48.177372 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 01:01:48.177436 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:48.177385 2576 projected.go:196] Error preparing data for projected volume kube-api-access-sfkg2 for pod openshift-network-diagnostics/network-check-target-4f25j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:48.177436 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:48.177384 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:48.177599 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:48.177448 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2 podName:cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f nodeName:}" failed. No retries permitted until 2026-07-07 01:02:20.177429923 +0000 UTC m=+66.183836697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sfkg2" (UniqueName: "kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2") pod "network-check-target-4f25j" (UID: "cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 01:01:48.177599 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:48.177467 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret podName:65d3c830-6ebf-4887-afe4-3ecb1691bb6d nodeName:}" failed. No retries permitted until 2026-07-07 01:02:20.177458723 +0000 UTC m=+66.183865489 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret") pod "global-pull-secret-syncer-68b5t" (UID: "65d3c830-6ebf-4887-afe4-3ecb1691bb6d") : object "kube-system"/"original-pull-secret" not registered Jul 07 01:01:48.278367 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:48.278332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:48.278532 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:48.278445 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:48.278532 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:48.278504 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs podName:ccb5b1b7-790f-47a0-8989-2137a06d173d nodeName:}" failed. No retries permitted until 2026-07-07 01:02:20.278489947 +0000 UTC m=+66.284896707 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs") pod "network-metrics-daemon-nq9d7" (UID: "ccb5b1b7-790f-47a0-8989-2137a06d173d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 01:01:48.542834 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:48.542762 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:48.542981 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:48.542897 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:48.768579 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:48.768547 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-blkpr_b79f0a2e-3ce0-4c33-b0c5-f1e686483118/dns-node-resolver/0.log" Jul 07 01:01:49.543243 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:49.543207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:49.543676 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:49.543339 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nq9d7" podUID="ccb5b1b7-790f-47a0-8989-2137a06d173d" Jul 07 01:01:49.543676 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:49.543396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:49.543676 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:49.543484 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-68b5t" podUID="65d3c830-6ebf-4887-afe4-3ecb1691bb6d" Jul 07 01:01:49.740059 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:49.740032 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r7dvk_e56f13aa-9d35-4077-b510-f68f88822098/node-ca/0.log" Jul 07 01:01:49.784040 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:49.784006 2576 generic.go:356] "Generic (PLEG): container finished" podID="d2584b87-48dc-450b-98ff-dd6684dc30be" containerID="4416fc40b1d5c2a8298d0a07da4e47a5a99a20bcc62caab888ea1aeac2d78697" exitCode=0 Jul 07 01:01:49.784220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:49.784056 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v74rp" event={"ID":"d2584b87-48dc-450b-98ff-dd6684dc30be","Type":"ContainerDied","Data":"4416fc40b1d5c2a8298d0a07da4e47a5a99a20bcc62caab888ea1aeac2d78697"} Jul 07 01:01:50.546706 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:50.546630 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:50.547081 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:01:50.546758 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4f25j" podUID="cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f" Jul 07 01:01:50.779230 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:50.779204 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-147.ec2.internal" event="NodeReady" Jul 07 01:01:50.779416 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:50.779362 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 01:01:51.542731 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:51.542696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:01:51.542898 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:51.542696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:01:51.546283 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:51.546066 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 01:01:51.546283 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:51.546113 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 01:01:51.546283 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:51.546114 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6nlk5\"" Jul 07 01:01:52.542786 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:52.542756 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:01:52.546081 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:52.546055 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 01:01:52.546209 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:52.546138 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 01:01:52.546291 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:52.546056 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpzcw\"" Jul 07 01:01:54.798495 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:54.798303 2576 generic.go:356] "Generic (PLEG): container finished" podID="d2584b87-48dc-450b-98ff-dd6684dc30be" containerID="67d9fc9f12df84adff67c13c20d1668a60c78c2bc69c78e66675462e68089e3d" exitCode=0 Jul 07 01:01:54.798885 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:54.798368 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v74rp" event={"ID":"d2584b87-48dc-450b-98ff-dd6684dc30be","Type":"ContainerDied","Data":"67d9fc9f12df84adff67c13c20d1668a60c78c2bc69c78e66675462e68089e3d"} Jul 07 01:01:55.803860 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:55.803829 2576 generic.go:356] "Generic (PLEG): container finished" podID="d2584b87-48dc-450b-98ff-dd6684dc30be" containerID="e2093b211a476eee781ca19eb6c0f5cfb8689bb73426abc837b6768e2020d537" exitCode=0 Jul 07 01:01:55.804236 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:55.803872 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v74rp" event={"ID":"d2584b87-48dc-450b-98ff-dd6684dc30be","Type":"ContainerDied","Data":"e2093b211a476eee781ca19eb6c0f5cfb8689bb73426abc837b6768e2020d537"} Jul 07 01:01:56.810007 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:56.809968 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v74rp" event={"ID":"d2584b87-48dc-450b-98ff-dd6684dc30be","Type":"ContainerStarted","Data":"c99cd6b1484931f2b0da05785bcfc283a83d45df018a9f37aa24fa63ea074c89"} Jul 07 01:01:56.833728 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:01:56.833676 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v74rp" podStartSLOduration=8.56297828 podStartE2EDuration="41.833660166s" totalImagesPullingTime="33.270681886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:01:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:01:56.83171256 +0000 UTC m=+42.838119342" watchObservedRunningTime="2026-07-07 01:01:56.833660166 +0000 UTC m=+42.840066947" Jul 07 01:02:10.443896 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.443862 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k62p5"] Jul 07 01:02:10.445814 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.445799 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.448870 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.448842 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 01:02:10.449007 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.448912 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 01:02:10.449007 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.448920 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 01:02:10.449007 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.448914 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-67m22\"" Jul 07 01:02:10.450295 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.450257 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 01:02:10.457382 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.457362 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6js9l"] Jul 07 01:02:10.459065 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.459047 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6js9l" Jul 07 01:02:10.460235 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.460217 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k62p5"] Jul 07 01:02:10.463056 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.463034 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 01:02:10.463156 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.463077 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4ln7z\"" Jul 07 01:02:10.463156 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.463092 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 01:02:10.475979 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.475953 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 01:02:10.482052 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.482022 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6js9l"] Jul 07 01:02:10.531973 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.531934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pzdl\" (UniqueName: \"kubernetes.io/projected/264510a7-fd6c-48f5-9e99-555a0fd28108-kube-api-access-2pzdl\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.532171 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.531984 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42hfs\" (UniqueName: \"kubernetes.io/projected/2737c20b-ff94-4457-ac24-de1ed78568fb-kube-api-access-42hfs\") pod \"ingress-canary-6js9l\" (UID: \"2737c20b-ff94-4457-ac24-de1ed78568fb\") " pod="openshift-ingress-canary/ingress-canary-6js9l" Jul 07 01:02:10.532171 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.532034 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/264510a7-fd6c-48f5-9e99-555a0fd28108-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.532171 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.532072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/264510a7-fd6c-48f5-9e99-555a0fd28108-crio-socket\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.532171 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.532132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/264510a7-fd6c-48f5-9e99-555a0fd28108-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.532375 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.532186 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/264510a7-fd6c-48f5-9e99-555a0fd28108-data-volume\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.532375 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.532212 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2737c20b-ff94-4457-ac24-de1ed78568fb-cert\") pod \"ingress-canary-6js9l\" (UID: \"2737c20b-ff94-4457-ac24-de1ed78568fb\") " pod="openshift-ingress-canary/ingress-canary-6js9l" Jul 07 01:02:10.546056 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.546027 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kxgqw"] Jul 07 01:02:10.548003 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.547987 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.551718 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.551166 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t9bjq\"" Jul 07 01:02:10.551718 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.551507 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 01:02:10.551938 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.551775 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 01:02:10.554831 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.554806 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65cb76c4c9-ss7cq"] Jul 07 01:02:10.560735 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.560714 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.563328 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.563302 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kxgqw"] Jul 07 01:02:10.572836 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.572803 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v8v29\"" Jul 07 01:02:10.573129 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.573106 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 01:02:10.576094 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.573373 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 01:02:10.576094 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.573390 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 01:02:10.576094 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.575383 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65cb76c4c9-ss7cq"] Jul 07 01:02:10.579765 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.579741 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 01:02:10.632894 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.632858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pzdl\" (UniqueName: \"kubernetes.io/projected/264510a7-fd6c-48f5-9e99-555a0fd28108-kube-api-access-2pzdl\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.632894 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.632896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5dddc459-a9e8-458a-b0a4-4535cea3682d-registry-certificates\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.633128 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.632918 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78b894c6-9bfd-4908-ba1c-a30ab7b48170-metrics-tls\") pod \"dns-default-kxgqw\" (UID: \"78b894c6-9bfd-4908-ba1c-a30ab7b48170\") " pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.633128 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.632937 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5dddc459-a9e8-458a-b0a4-4535cea3682d-trusted-ca\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.633128 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.632952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78b894c6-9bfd-4908-ba1c-a30ab7b48170-config-volume\") pod \"dns-default-kxgqw\" (UID: \"78b894c6-9bfd-4908-ba1c-a30ab7b48170\") " pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.633128 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv8zz\" (UniqueName: \"kubernetes.io/projected/78b894c6-9bfd-4908-ba1c-a30ab7b48170-kube-api-access-zv8zz\") pod \"dns-default-kxgqw\" (UID: \"78b894c6-9bfd-4908-ba1c-a30ab7b48170\") " pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.633128 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hfs\" (UniqueName: \"kubernetes.io/projected/2737c20b-ff94-4457-ac24-de1ed78568fb-kube-api-access-42hfs\") pod \"ingress-canary-6js9l\" (UID: \"2737c20b-ff94-4457-ac24-de1ed78568fb\") " pod="openshift-ingress-canary/ingress-canary-6js9l" Jul 07 01:02:10.633372 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5dddc459-a9e8-458a-b0a4-4535cea3682d-installation-pull-secrets\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.633372 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dddc459-a9e8-458a-b0a4-4535cea3682d-bound-sa-token\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.633372 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl2sx\" (UniqueName: \"kubernetes.io/projected/5dddc459-a9e8-458a-b0a4-4535cea3682d-kube-api-access-rl2sx\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.633372 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633192 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5dddc459-a9e8-458a-b0a4-4535cea3682d-ca-trust-extracted\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.633372 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/264510a7-fd6c-48f5-9e99-555a0fd28108-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.633372 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5dddc459-a9e8-458a-b0a4-4535cea3682d-registry-tls\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.633657 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5dddc459-a9e8-458a-b0a4-4535cea3682d-image-registry-private-configuration\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.633657 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/264510a7-fd6c-48f5-9e99-555a0fd28108-crio-socket\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.633657 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/264510a7-fd6c-48f5-9e99-555a0fd28108-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.633657 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633491 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/264510a7-fd6c-48f5-9e99-555a0fd28108-data-volume\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.633657 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2737c20b-ff94-4457-ac24-de1ed78568fb-cert\") pod \"ingress-canary-6js9l\" (UID: \"2737c20b-ff94-4457-ac24-de1ed78568fb\") " pod="openshift-ingress-canary/ingress-canary-6js9l" Jul 07 01:02:10.633657 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633523 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/264510a7-fd6c-48f5-9e99-555a0fd28108-crio-socket\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.633657 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78b894c6-9bfd-4908-ba1c-a30ab7b48170-tmp-dir\") pod \"dns-default-kxgqw\" (UID: \"78b894c6-9bfd-4908-ba1c-a30ab7b48170\") " pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.633858 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/264510a7-fd6c-48f5-9e99-555a0fd28108-data-volume\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.633911 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.633890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/264510a7-fd6c-48f5-9e99-555a0fd28108-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.637633 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.637599 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/264510a7-fd6c-48f5-9e99-555a0fd28108-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.637751 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.637702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2737c20b-ff94-4457-ac24-de1ed78568fb-cert\") pod \"ingress-canary-6js9l\" (UID: \"2737c20b-ff94-4457-ac24-de1ed78568fb\") " pod="openshift-ingress-canary/ingress-canary-6js9l" Jul 07 01:02:10.645522 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.645498 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-nhp9p"] Jul 07 01:02:10.647811 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.647796 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-nhp9p" Jul 07 01:02:10.650587 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.650563 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 01:02:10.650913 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.650890 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 01:02:10.651036 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.650961 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-67klg\"" Jul 07 01:02:10.651649 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.651620 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42hfs\" (UniqueName: \"kubernetes.io/projected/2737c20b-ff94-4457-ac24-de1ed78568fb-kube-api-access-42hfs\") pod \"ingress-canary-6js9l\" (UID: \"2737c20b-ff94-4457-ac24-de1ed78568fb\") " pod="openshift-ingress-canary/ingress-canary-6js9l" Jul 07 01:02:10.651946 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.651929 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pzdl\" (UniqueName: \"kubernetes.io/projected/264510a7-fd6c-48f5-9e99-555a0fd28108-kube-api-access-2pzdl\") pod \"insights-runtime-extractor-k62p5\" (UID: \"264510a7-fd6c-48f5-9e99-555a0fd28108\") " pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.658701 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.658675 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-nhp9p"] Jul 07 01:02:10.734388 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5dddc459-a9e8-458a-b0a4-4535cea3682d-registry-certificates\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.734388 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78b894c6-9bfd-4908-ba1c-a30ab7b48170-metrics-tls\") pod \"dns-default-kxgqw\" (UID: \"78b894c6-9bfd-4908-ba1c-a30ab7b48170\") " pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.734388 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h27jl\" (UniqueName: \"kubernetes.io/projected/5fdcd7a4-b8fc-49a3-8c9a-ed42b80e4e3e-kube-api-access-h27jl\") pod \"downloads-685bfb5f64-nhp9p\" (UID: \"5fdcd7a4-b8fc-49a3-8c9a-ed42b80e4e3e\") " pod="openshift-console/downloads-685bfb5f64-nhp9p" Jul 07 01:02:10.734388 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734373 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5dddc459-a9e8-458a-b0a4-4535cea3682d-trusted-ca\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.734388 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78b894c6-9bfd-4908-ba1c-a30ab7b48170-config-volume\") pod \"dns-default-kxgqw\" (UID: \"78b894c6-9bfd-4908-ba1c-a30ab7b48170\") " pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.734742 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv8zz\" (UniqueName: \"kubernetes.io/projected/78b894c6-9bfd-4908-ba1c-a30ab7b48170-kube-api-access-zv8zz\") pod \"dns-default-kxgqw\" (UID: \"78b894c6-9bfd-4908-ba1c-a30ab7b48170\") " pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.734742 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5dddc459-a9e8-458a-b0a4-4535cea3682d-installation-pull-secrets\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.734742 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dddc459-a9e8-458a-b0a4-4535cea3682d-bound-sa-token\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.734742 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl2sx\" (UniqueName: \"kubernetes.io/projected/5dddc459-a9e8-458a-b0a4-4535cea3682d-kube-api-access-rl2sx\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.734742 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5dddc459-a9e8-458a-b0a4-4535cea3682d-ca-trust-extracted\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.734742 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5dddc459-a9e8-458a-b0a4-4535cea3682d-registry-tls\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.734742 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5dddc459-a9e8-458a-b0a4-4535cea3682d-image-registry-private-configuration\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.734742 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78b894c6-9bfd-4908-ba1c-a30ab7b48170-tmp-dir\") pod \"dns-default-kxgqw\" (UID: \"78b894c6-9bfd-4908-ba1c-a30ab7b48170\") " pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.735129 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.734985 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78b894c6-9bfd-4908-ba1c-a30ab7b48170-tmp-dir\") pod \"dns-default-kxgqw\" (UID: \"78b894c6-9bfd-4908-ba1c-a30ab7b48170\") " pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.735186 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.735105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/78b894c6-9bfd-4908-ba1c-a30ab7b48170-config-volume\") pod \"dns-default-kxgqw\" (UID: \"78b894c6-9bfd-4908-ba1c-a30ab7b48170\") " pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.735186 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.735151 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5dddc459-a9e8-458a-b0a4-4535cea3682d-ca-trust-extracted\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.735523 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.735496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5dddc459-a9e8-458a-b0a4-4535cea3682d-registry-certificates\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.735712 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.735693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5dddc459-a9e8-458a-b0a4-4535cea3682d-trusted-ca\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.737023 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.737002 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/78b894c6-9bfd-4908-ba1c-a30ab7b48170-metrics-tls\") pod \"dns-default-kxgqw\" (UID: \"78b894c6-9bfd-4908-ba1c-a30ab7b48170\") " pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.737167 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.737150 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5dddc459-a9e8-458a-b0a4-4535cea3682d-installation-pull-secrets\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.737880 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.737861 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5dddc459-a9e8-458a-b0a4-4535cea3682d-image-registry-private-configuration\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.738003 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.737936 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5dddc459-a9e8-458a-b0a4-4535cea3682d-registry-tls\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.748073 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.748050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5dddc459-a9e8-458a-b0a4-4535cea3682d-bound-sa-token\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.748569 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.748554 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv8zz\" (UniqueName: \"kubernetes.io/projected/78b894c6-9bfd-4908-ba1c-a30ab7b48170-kube-api-access-zv8zz\") pod \"dns-default-kxgqw\" (UID: \"78b894c6-9bfd-4908-ba1c-a30ab7b48170\") " pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.754525 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.754505 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k62p5" Jul 07 01:02:10.758156 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.758118 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl2sx\" (UniqueName: \"kubernetes.io/projected/5dddc459-a9e8-458a-b0a4-4535cea3682d-kube-api-access-rl2sx\") pod \"image-registry-65cb76c4c9-ss7cq\" (UID: \"5dddc459-a9e8-458a-b0a4-4535cea3682d\") " pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.767917 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.767893 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6js9l" Jul 07 01:02:10.835855 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.835374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h27jl\" (UniqueName: \"kubernetes.io/projected/5fdcd7a4-b8fc-49a3-8c9a-ed42b80e4e3e-kube-api-access-h27jl\") pod \"downloads-685bfb5f64-nhp9p\" (UID: \"5fdcd7a4-b8fc-49a3-8c9a-ed42b80e4e3e\") " pod="openshift-console/downloads-685bfb5f64-nhp9p" Jul 07 01:02:10.845074 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.845046 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h27jl\" (UniqueName: \"kubernetes.io/projected/5fdcd7a4-b8fc-49a3-8c9a-ed42b80e4e3e-kube-api-access-h27jl\") pod \"downloads-685bfb5f64-nhp9p\" (UID: \"5fdcd7a4-b8fc-49a3-8c9a-ed42b80e4e3e\") " pod="openshift-console/downloads-685bfb5f64-nhp9p" Jul 07 01:02:10.882964 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.882927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:10.889091 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.889062 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:10.900625 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.900594 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k62p5"] Jul 07 01:02:10.903891 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:10.903858 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264510a7_fd6c_48f5_9e99_555a0fd28108.slice/crio-be2f98d89c058fefd92c379fa8f4b9be78b1be8255fe941ebad3821eedcbc785 WatchSource:0}: Error finding container be2f98d89c058fefd92c379fa8f4b9be78b1be8255fe941ebad3821eedcbc785: Status 404 returned error can't find the container with id be2f98d89c058fefd92c379fa8f4b9be78b1be8255fe941ebad3821eedcbc785 Jul 07 01:02:10.919018 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.918435 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6js9l"] Jul 07 01:02:10.921775 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:10.921745 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2737c20b_ff94_4457_ac24_de1ed78568fb.slice/crio-c3d6a7d494ea6b994cbebb11c669c3589bbeaabef7b29c637268456bc400a2ad WatchSource:0}: Error finding container c3d6a7d494ea6b994cbebb11c669c3589bbeaabef7b29c637268456bc400a2ad: Status 404 returned error can't find the container with id c3d6a7d494ea6b994cbebb11c669c3589bbeaabef7b29c637268456bc400a2ad Jul 07 01:02:10.962494 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:10.962461 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-nhp9p" Jul 07 01:02:11.033550 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:11.033515 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65cb76c4c9-ss7cq"] Jul 07 01:02:11.037654 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:11.037629 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dddc459_a9e8_458a_b0a4_4535cea3682d.slice/crio-13e5f9090bd4311ec8cb40f4e4728da29f0d8e5799cd038034b7b559b2c9ed0e WatchSource:0}: Error finding container 13e5f9090bd4311ec8cb40f4e4728da29f0d8e5799cd038034b7b559b2c9ed0e: Status 404 returned error can't find the container with id 13e5f9090bd4311ec8cb40f4e4728da29f0d8e5799cd038034b7b559b2c9ed0e Jul 07 01:02:11.048153 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:11.048130 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kxgqw"] Jul 07 01:02:11.050948 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:11.050919 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78b894c6_9bfd_4908_ba1c_a30ab7b48170.slice/crio-b60bd3b9dcae114d98fd6be470c35887f60a9839520810742d26c0b3f0c298b1 WatchSource:0}: Error finding container b60bd3b9dcae114d98fd6be470c35887f60a9839520810742d26c0b3f0c298b1: Status 404 returned error can't find the container with id b60bd3b9dcae114d98fd6be470c35887f60a9839520810742d26c0b3f0c298b1 Jul 07 01:02:11.098035 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:11.098005 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-nhp9p"] Jul 07 01:02:11.100453 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:11.100428 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdcd7a4_b8fc_49a3_8c9a_ed42b80e4e3e.slice/crio-e7830e1e13441bcdebd7d7131380353eb62d43fe3b0535329877a495e662000a WatchSource:0}: Error finding container e7830e1e13441bcdebd7d7131380353eb62d43fe3b0535329877a495e662000a: Status 404 returned error can't find the container with id e7830e1e13441bcdebd7d7131380353eb62d43fe3b0535329877a495e662000a Jul 07 01:02:11.850067 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:11.850023 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" event={"ID":"5dddc459-a9e8-458a-b0a4-4535cea3682d","Type":"ContainerStarted","Data":"c0aac21ad268633bbc7fbb2760910b448eca8a4d7df822bd01c078542ccf4aef"} Jul 07 01:02:11.850679 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:11.850094 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" event={"ID":"5dddc459-a9e8-458a-b0a4-4535cea3682d","Type":"ContainerStarted","Data":"13e5f9090bd4311ec8cb40f4e4728da29f0d8e5799cd038034b7b559b2c9ed0e"} Jul 07 01:02:11.850926 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:11.850869 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:11.852993 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:11.852900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k62p5" event={"ID":"264510a7-fd6c-48f5-9e99-555a0fd28108","Type":"ContainerStarted","Data":"be2f98d89c058fefd92c379fa8f4b9be78b1be8255fe941ebad3821eedcbc785"} Jul 07 01:02:11.855042 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:11.854980 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6js9l" event={"ID":"2737c20b-ff94-4457-ac24-de1ed78568fb","Type":"ContainerStarted","Data":"c3d6a7d494ea6b994cbebb11c669c3589bbeaabef7b29c637268456bc400a2ad"} Jul 07 01:02:11.858828 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:11.858726 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-nhp9p" event={"ID":"5fdcd7a4-b8fc-49a3-8c9a-ed42b80e4e3e","Type":"ContainerStarted","Data":"e7830e1e13441bcdebd7d7131380353eb62d43fe3b0535329877a495e662000a"} Jul 07 01:02:11.862400 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:11.862337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kxgqw" event={"ID":"78b894c6-9bfd-4908-ba1c-a30ab7b48170","Type":"ContainerStarted","Data":"b60bd3b9dcae114d98fd6be470c35887f60a9839520810742d26c0b3f0c298b1"} Jul 07 01:02:11.873215 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:11.873154 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" podStartSLOduration=1.873135865 podStartE2EDuration="1.873135865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:11.871427224 +0000 UTC m=+57.877834027" watchObservedRunningTime="2026-07-07 01:02:11.873135865 +0000 UTC m=+57.879542641" Jul 07 01:02:15.492359 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:15.492317 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk"] Jul 07 01:02:15.517973 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:15.517943 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk"] Jul 07 01:02:15.518157 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:15.518055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk" Jul 07 01:02:15.521472 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:15.521434 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cjp5b\"" Jul 07 01:02:15.521611 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:15.521521 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 01:02:15.578676 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:15.578633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a903d6c8-ca63-44d0-832c-f0a999c3ae23-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2s2hk\" (UID: \"a903d6c8-ca63-44d0-832c-f0a999c3ae23\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk" Jul 07 01:02:15.679398 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:15.679360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a903d6c8-ca63-44d0-832c-f0a999c3ae23-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2s2hk\" (UID: \"a903d6c8-ca63-44d0-832c-f0a999c3ae23\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk" Jul 07 01:02:15.681859 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:15.681827 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a903d6c8-ca63-44d0-832c-f0a999c3ae23-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2s2hk\" (UID: \"a903d6c8-ca63-44d0-832c-f0a999c3ae23\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk" Jul 07 01:02:15.830475 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:15.830389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk" Jul 07 01:02:16.722582 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.722536 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f675f9fb8-82wph"] Jul 07 01:02:16.725703 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.725680 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.728315 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.728294 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 01:02:16.729894 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.729861 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 01:02:16.730023 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.729897 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 01:02:16.730473 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.730445 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rcjg8\"" Jul 07 01:02:16.730696 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.730683 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 01:02:16.730894 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.730882 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 01:02:16.734333 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.734312 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f675f9fb8-82wph"] Jul 07 01:02:16.788540 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.787237 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-88d5w" Jul 07 01:02:16.790494 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.790361 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4994fb0b-598c-4bd7-a36f-247894fc7253-console-serving-cert\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.790494 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.790406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4994fb0b-598c-4bd7-a36f-247894fc7253-console-oauth-config\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.790494 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.790442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-oauth-serving-cert\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.790744 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.790540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-service-ca\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.790744 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.790580 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4zc2\" (UniqueName: \"kubernetes.io/projected/4994fb0b-598c-4bd7-a36f-247894fc7253-kube-api-access-v4zc2\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.790744 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.790617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-console-config\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.891067 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.891022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-oauth-serving-cert\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.891252 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.891124 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-service-ca\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.891252 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.891152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zc2\" (UniqueName: \"kubernetes.io/projected/4994fb0b-598c-4bd7-a36f-247894fc7253-kube-api-access-v4zc2\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.891252 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.891185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-console-config\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.891458 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.891326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4994fb0b-598c-4bd7-a36f-247894fc7253-console-serving-cert\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.891458 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.891355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4994fb0b-598c-4bd7-a36f-247894fc7253-console-oauth-config\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.891784 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.891758 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-oauth-serving-cert\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.892643 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.892606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-console-config\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.892643 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.892629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-service-ca\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.895160 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.895132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4994fb0b-598c-4bd7-a36f-247894fc7253-console-oauth-config\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.895295 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.895140 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4994fb0b-598c-4bd7-a36f-247894fc7253-console-serving-cert\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:16.901090 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:16.901026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4zc2\" (UniqueName: \"kubernetes.io/projected/4994fb0b-598c-4bd7-a36f-247894fc7253-kube-api-access-v4zc2\") pod \"console-7f675f9fb8-82wph\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:17.040873 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.040594 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:17.140930 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.140856 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk"] Jul 07 01:02:17.145799 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:17.145750 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda903d6c8_ca63_44d0_832c_f0a999c3ae23.slice/crio-4cde4fc2a2742100dce750c3882eacf9d41bd27a32a550d1e9dddfc541359ce0 WatchSource:0}: Error finding container 4cde4fc2a2742100dce750c3882eacf9d41bd27a32a550d1e9dddfc541359ce0: Status 404 returned error can't find the container with id 4cde4fc2a2742100dce750c3882eacf9d41bd27a32a550d1e9dddfc541359ce0 Jul 07 01:02:17.230530 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.230499 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f675f9fb8-82wph"] Jul 07 01:02:17.235902 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:17.235872 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4994fb0b_598c_4bd7_a36f_247894fc7253.slice/crio-a7bdae8dbb63a94cafd7bb3f2d0a1ccbfea9a50b1f59c368425e49a9ceaea6bf WatchSource:0}: Error finding container a7bdae8dbb63a94cafd7bb3f2d0a1ccbfea9a50b1f59c368425e49a9ceaea6bf: Status 404 returned error can't find the container with id a7bdae8dbb63a94cafd7bb3f2d0a1ccbfea9a50b1f59c368425e49a9ceaea6bf Jul 07 01:02:17.884463 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.884422 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kxgqw" event={"ID":"78b894c6-9bfd-4908-ba1c-a30ab7b48170","Type":"ContainerStarted","Data":"901c43086191453fa428879bee275ddbd5aa59d165b03c6f6aa1835ac11cfca9"} Jul 07 01:02:17.884933 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.884488 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kxgqw" event={"ID":"78b894c6-9bfd-4908-ba1c-a30ab7b48170","Type":"ContainerStarted","Data":"bb8b95fd6edcd90fa5ae57b7ac9e26db4bb71d0e5c03e1587a1180cbcef18cca"} Jul 07 01:02:17.884933 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.884538 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:17.885790 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.885764 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk" event={"ID":"a903d6c8-ca63-44d0-832c-f0a999c3ae23","Type":"ContainerStarted","Data":"4cde4fc2a2742100dce750c3882eacf9d41bd27a32a550d1e9dddfc541359ce0"} Jul 07 01:02:17.887749 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.887722 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k62p5" event={"ID":"264510a7-fd6c-48f5-9e99-555a0fd28108","Type":"ContainerStarted","Data":"8feb69fb6891c721807353474e0ff059d8c4ad3fbdcf5a7ffd752486a31ea07b"} Jul 07 01:02:17.887911 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.887772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k62p5" event={"ID":"264510a7-fd6c-48f5-9e99-555a0fd28108","Type":"ContainerStarted","Data":"c5227c82f5cb2269a916addada6adf78fa5887404480c96a204751c1c7c305f6"} Jul 07 01:02:17.889374 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.889350 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6js9l" event={"ID":"2737c20b-ff94-4457-ac24-de1ed78568fb","Type":"ContainerStarted","Data":"12d6eab229410a2b12336445c7791cb8281fdb6dc1c8d96c95eb974c79f91e81"} Jul 07 01:02:17.890549 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.890529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f675f9fb8-82wph" event={"ID":"4994fb0b-598c-4bd7-a36f-247894fc7253","Type":"ContainerStarted","Data":"a7bdae8dbb63a94cafd7bb3f2d0a1ccbfea9a50b1f59c368425e49a9ceaea6bf"} Jul 07 01:02:17.902241 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.902187 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kxgqw" podStartSLOduration=1.984592003 podStartE2EDuration="7.902171275s" totalImagesPullingTime="5.917579272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:17.900362309 +0000 UTC m=+63.906769093" watchObservedRunningTime="2026-07-07 01:02:17.902171275 +0000 UTC m=+63.908578036" Jul 07 01:02:17.915418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:17.915363 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6js9l" podStartSLOduration=1.860359818 podStartE2EDuration="7.915344619s" totalImagesPullingTime="6.054984801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:17.914828027 +0000 UTC m=+63.921234819" watchObservedRunningTime="2026-07-07 01:02:17.915344619 +0000 UTC m=+63.921751394" Jul 07 01:02:20.221752 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.221711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:02:20.222214 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.221799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfkg2\" (UniqueName: \"kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2\") pod \"network-check-target-4f25j\" (UID: \"cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f\") " pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:02:20.225089 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.224900 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 01:02:20.225089 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.224956 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 01:02:20.237241 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.234852 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 01:02:20.237241 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.235211 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/65d3c830-6ebf-4887-afe4-3ecb1691bb6d-original-pull-secret\") pod \"global-pull-secret-syncer-68b5t\" (UID: \"65d3c830-6ebf-4887-afe4-3ecb1691bb6d\") " pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:02:20.246085 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.246053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfkg2\" (UniqueName: \"kubernetes.io/projected/cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f-kube-api-access-sfkg2\") pod \"network-check-target-4f25j\" (UID: \"cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f\") " pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:02:20.322968 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.322928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:02:20.326108 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.326082 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 01:02:20.337745 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.337681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccb5b1b7-790f-47a0-8989-2137a06d173d-metrics-certs\") pod \"network-metrics-daemon-nq9d7\" (UID: \"ccb5b1b7-790f-47a0-8989-2137a06d173d\") " pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:02:20.355884 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.355852 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-68b5t" Jul 07 01:02:20.364571 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.364095 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6nlk5\"" Jul 07 01:02:20.371574 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.371552 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nq9d7" Jul 07 01:02:20.455194 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.455163 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cpzcw\"" Jul 07 01:02:20.462609 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:20.462574 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:02:22.522966 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.522880 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4f25j"] Jul 07 01:02:22.531000 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:22.529767 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0ecb8f_0a2a_4e4a_87f8_efe0b7b9f75f.slice/crio-acc539382d0575d30459aad95ffc059098c96f96146c721055d7c8a9ac76e8db WatchSource:0}: Error finding container acc539382d0575d30459aad95ffc059098c96f96146c721055d7c8a9ac76e8db: Status 404 returned error can't find the container with id acc539382d0575d30459aad95ffc059098c96f96146c721055d7c8a9ac76e8db Jul 07 01:02:22.553539 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.553340 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-68b5t"] Jul 07 01:02:22.556483 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:22.556451 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d3c830_6ebf_4887_afe4_3ecb1691bb6d.slice/crio-de963a7f37dabf824e7ae8d1ed51fe10406a795d10e73aac9e262e73eff7bd45 WatchSource:0}: Error finding container de963a7f37dabf824e7ae8d1ed51fe10406a795d10e73aac9e262e73eff7bd45: Status 404 returned error can't find the container with id de963a7f37dabf824e7ae8d1ed51fe10406a795d10e73aac9e262e73eff7bd45 Jul 07 01:02:22.556640 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.556597 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nq9d7"] Jul 07 01:02:22.563087 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:22.563063 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb5b1b7_790f_47a0_8989_2137a06d173d.slice/crio-2848d14dec98fa38d254e5558d4f7e707ef2694b0a83ed6a0beda26764e78bf1 WatchSource:0}: Error finding container 2848d14dec98fa38d254e5558d4f7e707ef2694b0a83ed6a0beda26764e78bf1: Status 404 returned error can't find the container with id 2848d14dec98fa38d254e5558d4f7e707ef2694b0a83ed6a0beda26764e78bf1 Jul 07 01:02:22.914519 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.914450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-68b5t" event={"ID":"65d3c830-6ebf-4887-afe4-3ecb1691bb6d","Type":"ContainerStarted","Data":"de963a7f37dabf824e7ae8d1ed51fe10406a795d10e73aac9e262e73eff7bd45"} Jul 07 01:02:22.917407 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.916912 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk" event={"ID":"a903d6c8-ca63-44d0-832c-f0a999c3ae23","Type":"ContainerStarted","Data":"222948d6ea0852719f8aa2799e7b286d51c7f6591454a10d783882a172c2e515"} Jul 07 01:02:22.917407 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.917194 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk" Jul 07 01:02:22.920505 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.920476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k62p5" event={"ID":"264510a7-fd6c-48f5-9e99-555a0fd28108","Type":"ContainerStarted","Data":"c1c63c7d36dfd38dd5a7f86c75111c8564258709cc85c41e5bccbc518fedf2b6"} Jul 07 01:02:22.922406 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.922381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nq9d7" event={"ID":"ccb5b1b7-790f-47a0-8989-2137a06d173d","Type":"ContainerStarted","Data":"2848d14dec98fa38d254e5558d4f7e707ef2694b0a83ed6a0beda26764e78bf1"} Jul 07 01:02:22.923678 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.923657 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk" Jul 07 01:02:22.924993 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.924970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4f25j" event={"ID":"cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f","Type":"ContainerStarted","Data":"acc539382d0575d30459aad95ffc059098c96f96146c721055d7c8a9ac76e8db"} Jul 07 01:02:22.927296 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.927001 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f675f9fb8-82wph" event={"ID":"4994fb0b-598c-4bd7-a36f-247894fc7253","Type":"ContainerStarted","Data":"8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a"} Jul 07 01:02:22.933784 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.933732 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2s2hk" podStartSLOduration=2.733316834 podStartE2EDuration="7.933719943s" totalImagesPullingTime="5.200403109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:22.933247997 +0000 UTC m=+68.939654779" watchObservedRunningTime="2026-07-07 01:02:22.933719943 +0000 UTC m=+68.940126725" Jul 07 01:02:22.951095 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.951029 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f675f9fb8-82wph" podStartSLOduration=1.8437579720000001 podStartE2EDuration="6.951009376s" totalImagesPullingTime="5.107251404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:22.949773234 +0000 UTC m=+68.956180016" watchObservedRunningTime="2026-07-07 01:02:22.951009376 +0000 UTC m=+68.957416160" Jul 07 01:02:22.990452 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:22.990384 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k62p5" podStartSLOduration=1.6921227779999999 podStartE2EDuration="12.990360385s" totalImagesPullingTime="11.298237607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:02:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:22.971050793 +0000 UTC m=+68.977457574" watchObservedRunningTime="2026-07-07 01:02:22.990360385 +0000 UTC m=+68.996767169" Jul 07 01:02:23.546063 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.545031 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j"] Jul 07 01:02:23.548511 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.548435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:23.551472 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.551257 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 01:02:23.551472 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.551354 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 01:02:23.551635 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.551498 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 01:02:23.554555 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.553664 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-h9zqq\"" Jul 07 01:02:23.554555 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.553933 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 01:02:23.554555 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.554119 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 01:02:23.559136 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.559063 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j"] Jul 07 01:02:23.651874 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.651839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/583371ff-b6da-4006-b443-09928b8f3be9-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:23.651874 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.651887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/583371ff-b6da-4006-b443-09928b8f3be9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:23.652128 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.651916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/583371ff-b6da-4006-b443-09928b8f3be9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:23.652128 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.651975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm8rf\" (UniqueName: \"kubernetes.io/projected/583371ff-b6da-4006-b443-09928b8f3be9-kube-api-access-fm8rf\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:23.752494 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.752449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/583371ff-b6da-4006-b443-09928b8f3be9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:23.752687 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.752532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm8rf\" (UniqueName: \"kubernetes.io/projected/583371ff-b6da-4006-b443-09928b8f3be9-kube-api-access-fm8rf\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:23.752687 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.752574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/583371ff-b6da-4006-b443-09928b8f3be9-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:23.752687 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.752606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/583371ff-b6da-4006-b443-09928b8f3be9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:23.752864 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:02:23.752707 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 07 01:02:23.752864 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:02:23.752776 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/583371ff-b6da-4006-b443-09928b8f3be9-prometheus-operator-tls podName:583371ff-b6da-4006-b443-09928b8f3be9 nodeName:}" failed. No retries permitted until 2026-07-07 01:02:24.252755028 +0000 UTC m=+70.259161791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/583371ff-b6da-4006-b443-09928b8f3be9-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-f9p4j" (UID: "583371ff-b6da-4006-b443-09928b8f3be9") : secret "prometheus-operator-tls" not found Jul 07 01:02:23.753357 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.753331 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/583371ff-b6da-4006-b443-09928b8f3be9-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:23.755943 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.755914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/583371ff-b6da-4006-b443-09928b8f3be9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:23.764323 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:23.764252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm8rf\" (UniqueName: \"kubernetes.io/projected/583371ff-b6da-4006-b443-09928b8f3be9-kube-api-access-fm8rf\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:24.257956 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:24.257850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/583371ff-b6da-4006-b443-09928b8f3be9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:24.260921 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:24.260870 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/583371ff-b6da-4006-b443-09928b8f3be9-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-f9p4j\" (UID: \"583371ff-b6da-4006-b443-09928b8f3be9\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:24.466326 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:24.466287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" Jul 07 01:02:27.041978 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.041925 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:27.042481 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.042006 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:27.048523 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.048497 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:27.314476 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.314391 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78db79756f-kml8p"] Jul 07 01:02:27.318062 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.318037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.328019 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.327991 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 01:02:27.328152 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.328116 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78db79756f-kml8p"] Jul 07 01:02:27.384074 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.384022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-oauth-serving-cert\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.384322 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.384100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-serving-cert\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.384322 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.384129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-oauth-config\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.384322 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.384154 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-service-ca\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.384322 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.384191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-config\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.384322 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.384218 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6px2f\" (UniqueName: \"kubernetes.io/projected/3855efd2-419d-4ad1-a5d2-7f5d65192467-kube-api-access-6px2f\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.384534 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.384338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-trusted-ca-bundle\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.485185 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.485144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-config\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.485411 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.485198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6px2f\" (UniqueName: \"kubernetes.io/projected/3855efd2-419d-4ad1-a5d2-7f5d65192467-kube-api-access-6px2f\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.485411 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.485236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-trusted-ca-bundle\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.485411 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.485400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-oauth-serving-cert\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.485577 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.485469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-serving-cert\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.485577 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.485500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-oauth-config\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.485577 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.485525 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-service-ca\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.485974 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.485949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-config\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.486137 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.486115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-oauth-serving-cert\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.486230 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.486209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-trusted-ca-bundle\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.486309 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.486223 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-service-ca\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.488453 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.488428 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-oauth-config\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.488587 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.488564 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-serving-cert\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.493599 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.493576 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6px2f\" (UniqueName: \"kubernetes.io/projected/3855efd2-419d-4ad1-a5d2-7f5d65192467-kube-api-access-6px2f\") pod \"console-78db79756f-kml8p\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.630953 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.630912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:27.900964 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.900875 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kxgqw" Jul 07 01:02:27.952256 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:27.952180 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:02:33.875982 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:33.875946 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65cb76c4c9-ss7cq" Jul 07 01:02:35.294830 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.294782 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78db79756f-kml8p"] Jul 07 01:02:35.314157 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.312711 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j"] Jul 07 01:02:35.316526 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:35.316166 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod583371ff_b6da_4006_b443_09928b8f3be9.slice/crio-67c034694f7477a321390f9ca84f3dcc917b3b4b67a96cf535c5844ccbaf7853 WatchSource:0}: Error finding container 67c034694f7477a321390f9ca84f3dcc917b3b4b67a96cf535c5844ccbaf7853: Status 404 returned error can't find the container with id 67c034694f7477a321390f9ca84f3dcc917b3b4b67a96cf535c5844ccbaf7853 Jul 07 01:02:35.982162 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.982124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-nhp9p" event={"ID":"5fdcd7a4-b8fc-49a3-8c9a-ed42b80e4e3e","Type":"ContainerStarted","Data":"2ddd11b6314dece1c0c21f3cfab9e79715ae2a0498424e3fb62fef31587eee5f"} Jul 07 01:02:35.982384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.982309 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-nhp9p" Jul 07 01:02:35.984211 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.984160 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-68b5t" event={"ID":"65d3c830-6ebf-4887-afe4-3ecb1691bb6d","Type":"ContainerStarted","Data":"9d2e18ddab537b84aeb36aec5583c73bf56ff894d5f3202ec6c00c37e065e9a8"} Jul 07 01:02:35.986221 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.986195 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nq9d7" event={"ID":"ccb5b1b7-790f-47a0-8989-2137a06d173d","Type":"ContainerStarted","Data":"769c48a4b2420b438272b5e4d430e2f1e4dfc5c6e8be2c3433adb3e48e162014"} Jul 07 01:02:35.986353 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.986240 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nq9d7" event={"ID":"ccb5b1b7-790f-47a0-8989-2137a06d173d","Type":"ContainerStarted","Data":"6a6b99bcb29f736a2f6c58054cc554eb143533aad1537f11a9ef457e5ca0dbad"} Jul 07 01:02:35.987881 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.987825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4f25j" event={"ID":"cc0ecb8f-0a2a-4e4a-87f8-efe0b7b9f75f","Type":"ContainerStarted","Data":"d86f6c00cfbd0539e88efc9522ffae28c75c3426a29f66b76c75082ddb706a48"} Jul 07 01:02:35.988001 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.987935 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:02:35.989697 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.989669 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78db79756f-kml8p" event={"ID":"3855efd2-419d-4ad1-a5d2-7f5d65192467","Type":"ContainerStarted","Data":"6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc"} Jul 07 01:02:35.989816 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.989715 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78db79756f-kml8p" event={"ID":"3855efd2-419d-4ad1-a5d2-7f5d65192467","Type":"ContainerStarted","Data":"e51f25cc64c4ccbbc6c9cfdc3490aff858fc6614a18515db85cb82e22fab62d3"} Jul 07 01:02:35.991010 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.990987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" event={"ID":"583371ff-b6da-4006-b443-09928b8f3be9","Type":"ContainerStarted","Data":"67c034694f7477a321390f9ca84f3dcc917b3b4b67a96cf535c5844ccbaf7853"} Jul 07 01:02:35.997885 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:35.997860 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-nhp9p" Jul 07 01:02:36.002439 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:36.002381 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-nhp9p" podStartSLOduration=2.010763229 podStartE2EDuration="26.002364152s" totalImagesPullingTime="23.991600923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:36.000167622 +0000 UTC m=+82.006574436" watchObservedRunningTime="2026-07-07 01:02:36.002364152 +0000 UTC m=+82.008770933" Jul 07 01:02:36.017992 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:36.017926 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4f25j" podStartSLOduration=68.455410507 podStartE2EDuration="1m21.017908865s" totalImagesPullingTime="12.562498358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:36.01754089 +0000 UTC m=+82.023947700" watchObservedRunningTime="2026-07-07 01:02:36.017908865 +0000 UTC m=+82.024315647" Jul 07 01:02:36.035580 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:36.035354 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78db79756f-kml8p" podStartSLOduration=9.035332848 podStartE2EDuration="9.035332848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:36.034523753 +0000 UTC m=+82.040930536" watchObservedRunningTime="2026-07-07 01:02:36.035332848 +0000 UTC m=+82.041739630" Jul 07 01:02:36.052057 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:36.052000 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-68b5t" podStartSLOduration=68.50462978 podStartE2EDuration="1m21.051981992s" totalImagesPullingTime="12.547352212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:36.050973684 +0000 UTC m=+82.057380465" watchObservedRunningTime="2026-07-07 01:02:36.051981992 +0000 UTC m=+82.058388795" Jul 07 01:02:36.067090 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:36.067021 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nq9d7" podStartSLOduration=68.53712252 podStartE2EDuration="1m21.066998133s" totalImagesPullingTime="12.529875613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:36.065672013 +0000 UTC m=+82.072078817" watchObservedRunningTime="2026-07-07 01:02:36.066998133 +0000 UTC m=+82.073404916" Jul 07 01:02:37.631449 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:37.631411 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:37.631853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:37.631477 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:37.637303 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:37.637253 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:38.003492 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:38.003449 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" event={"ID":"583371ff-b6da-4006-b443-09928b8f3be9","Type":"ContainerStarted","Data":"4cfbf9f43fb6a8943bf896b2b4fce1c4bd694a4d3d4bbe8cdbd58946b172a467"} Jul 07 01:02:38.003759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:38.003737 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" event={"ID":"583371ff-b6da-4006-b443-09928b8f3be9","Type":"ContainerStarted","Data":"4f1e4e1f62f0fc8ad0446ba3c5434585d0da80a66f5a68d52f067d8640b44f2e"} Jul 07 01:02:38.008950 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:38.008920 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:02:38.021466 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:38.021403 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-f9p4j" podStartSLOduration=12.777703273 podStartE2EDuration="15.021380552s" totalImagesPullingTime="2.243677279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:38.019941243 +0000 UTC m=+84.026348046" watchObservedRunningTime="2026-07-07 01:02:38.021380552 +0000 UTC m=+84.027787337" Jul 07 01:02:38.067546 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:38.067502 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f675f9fb8-82wph"] Jul 07 01:02:39.852785 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.852741 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j"] Jul 07 01:02:39.884221 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.884184 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cdxl2"] Jul 07 01:02:39.884532 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.884302 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:39.887705 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.887676 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 07 01:02:39.887705 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.887676 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dws2d\"" Jul 07 01:02:39.887911 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.887749 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 07 01:02:39.902581 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.902545 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j"] Jul 07 01:02:39.902754 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.902625 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9"] Jul 07 01:02:39.902853 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.902567 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:39.906103 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.906073 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 01:02:39.906488 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.906467 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v6mvv\"" Jul 07 01:02:39.906800 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.906525 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 01:02:39.907035 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.907013 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 01:02:39.916644 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.916615 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9"] Jul 07 01:02:39.916773 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.916740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:39.919963 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.919942 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 01:02:39.920165 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.920151 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pr54p\"" Jul 07 01:02:39.920502 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.920483 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 01:02:39.920738 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.920650 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 01:02:39.991012 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.990967 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9731734c-7a19-42cb-9d7b-a68c13df6505-sys\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:39.991229 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-textfile\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:39.991229 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:39.991229 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1828852c-70ef-4295-ad42-ce6ff2ef9842-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:39.991229 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9731734c-7a19-42cb-9d7b-a68c13df6505-root\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:39.991229 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fdf14b9-97aa-4ee6-a17a-faa4fc120060-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5cl5j\" (UID: \"9fdf14b9-97aa-4ee6-a17a-faa4fc120060\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:39.991229 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:39.991551 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdf14b9-97aa-4ee6-a17a-faa4fc120060-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5cl5j\" (UID: \"9fdf14b9-97aa-4ee6-a17a-faa4fc120060\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:39.991551 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:39.991551 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:39.991551 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991387 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9731734c-7a19-42cb-9d7b-a68c13df6505-metrics-client-ca\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:39.991551 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2cjm\" (UniqueName: \"kubernetes.io/projected/9fdf14b9-97aa-4ee6-a17a-faa4fc120060-kube-api-access-w2cjm\") pod \"openshift-state-metrics-54cf96dfcf-5cl5j\" (UID: \"9fdf14b9-97aa-4ee6-a17a-faa4fc120060\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:39.991551 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fdf14b9-97aa-4ee6-a17a-faa4fc120060-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5cl5j\" (UID: \"9fdf14b9-97aa-4ee6-a17a-faa4fc120060\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:39.991551 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-accelerators-collector-config\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:39.991551 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqc4h\" (UniqueName: \"kubernetes.io/projected/9731734c-7a19-42cb-9d7b-a68c13df6505-kube-api-access-hqc4h\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:39.991851 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2x6w\" (UniqueName: \"kubernetes.io/projected/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-api-access-p2x6w\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:39.991851 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1828852c-70ef-4295-ad42-ce6ff2ef9842-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:39.991851 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-tls\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:39.991851 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:39.991649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-wtmp\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.093149 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.093102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.093149 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.093148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1828852c-70ef-4295-ad42-ce6ff2ef9842-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.093439 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.093201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9731734c-7a19-42cb-9d7b-a68c13df6505-root\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.094056 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.093229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fdf14b9-97aa-4ee6-a17a-faa4fc120060-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5cl5j\" (UID: \"9fdf14b9-97aa-4ee6-a17a-faa4fc120060\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:40.094171 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.094171 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdf14b9-97aa-4ee6-a17a-faa4fc120060-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5cl5j\" (UID: \"9fdf14b9-97aa-4ee6-a17a-faa4fc120060\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:40.094171 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.093334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9731734c-7a19-42cb-9d7b-a68c13df6505-root\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.094171 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094015 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1828852c-70ef-4295-ad42-ce6ff2ef9842-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.094409 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.093980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fdf14b9-97aa-4ee6-a17a-faa4fc120060-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-5cl5j\" (UID: \"9fdf14b9-97aa-4ee6-a17a-faa4fc120060\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:40.094409 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.094409 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.094409 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094330 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9731734c-7a19-42cb-9d7b-a68c13df6505-metrics-client-ca\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.094409 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2cjm\" (UniqueName: \"kubernetes.io/projected/9fdf14b9-97aa-4ee6-a17a-faa4fc120060-kube-api-access-w2cjm\") pod \"openshift-state-metrics-54cf96dfcf-5cl5j\" (UID: \"9fdf14b9-97aa-4ee6-a17a-faa4fc120060\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:40.094660 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094427 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fdf14b9-97aa-4ee6-a17a-faa4fc120060-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5cl5j\" (UID: \"9fdf14b9-97aa-4ee6-a17a-faa4fc120060\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:40.094660 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-accelerators-collector-config\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.094660 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqc4h\" (UniqueName: \"kubernetes.io/projected/9731734c-7a19-42cb-9d7b-a68c13df6505-kube-api-access-hqc4h\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.094660 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2x6w\" (UniqueName: \"kubernetes.io/projected/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-api-access-p2x6w\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.094660 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1828852c-70ef-4295-ad42-ce6ff2ef9842-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.094660 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:02:40.093275 2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 07 01:02:40.094660 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-tls\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.094660 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-wtmp\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.094660 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:02:40.094656 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-state-metrics-tls podName:1828852c-70ef-4295-ad42-ce6ff2ef9842 nodeName:}" failed. No retries permitted until 2026-07-07 01:02:40.594632006 +0000 UTC m=+86.601038783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-j6vq9" (UID: "1828852c-70ef-4295-ad42-ce6ff2ef9842") : secret "kube-state-metrics-tls" not found Jul 07 01:02:40.095256 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9731734c-7a19-42cb-9d7b-a68c13df6505-sys\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.095256 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-textfile\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.095256 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.094756 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-wtmp\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.095440 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.095306 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9731734c-7a19-42cb-9d7b-a68c13df6505-sys\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.095606 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.095577 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-textfile\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.096239 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.096206 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.096376 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.096315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-accelerators-collector-config\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.096557 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.096531 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1828852c-70ef-4295-ad42-ce6ff2ef9842-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.096686 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:02:40.096668 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 01:02:40.096812 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:02:40.096730 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-tls podName:9731734c-7a19-42cb-9d7b-a68c13df6505 nodeName:}" failed. No retries permitted until 2026-07-07 01:02:40.596712708 +0000 UTC m=+86.603119482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-tls") pod "node-exporter-cdxl2" (UID: "9731734c-7a19-42cb-9d7b-a68c13df6505") : secret "node-exporter-tls" not found Jul 07 01:02:40.097232 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.097202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9731734c-7a19-42cb-9d7b-a68c13df6505-metrics-client-ca\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.098011 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.097987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.100055 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.100033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fdf14b9-97aa-4ee6-a17a-faa4fc120060-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-5cl5j\" (UID: \"9fdf14b9-97aa-4ee6-a17a-faa4fc120060\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:40.100419 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.100367 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fdf14b9-97aa-4ee6-a17a-faa4fc120060-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-5cl5j\" (UID: \"9fdf14b9-97aa-4ee6-a17a-faa4fc120060\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:40.105416 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.105142 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.115976 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.115941 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqc4h\" (UniqueName: \"kubernetes.io/projected/9731734c-7a19-42cb-9d7b-a68c13df6505-kube-api-access-hqc4h\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.116252 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.116224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2x6w\" (UniqueName: \"kubernetes.io/projected/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-api-access-p2x6w\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.117759 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.117734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2cjm\" (UniqueName: \"kubernetes.io/projected/9fdf14b9-97aa-4ee6-a17a-faa4fc120060-kube-api-access-w2cjm\") pod \"openshift-state-metrics-54cf96dfcf-5cl5j\" (UID: \"9fdf14b9-97aa-4ee6-a17a-faa4fc120060\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:40.197128 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.197087 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" Jul 07 01:02:40.407074 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.406991 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j"] Jul 07 01:02:40.410598 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:40.410557 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fdf14b9_97aa_4ee6_a17a_faa4fc120060.slice/crio-046ad52226f1990e5631262bb96025476c3e9db7fb68a265ca61a7de71852b39 WatchSource:0}: Error finding container 046ad52226f1990e5631262bb96025476c3e9db7fb68a265ca61a7de71852b39: Status 404 returned error can't find the container with id 046ad52226f1990e5631262bb96025476c3e9db7fb68a265ca61a7de71852b39 Jul 07 01:02:40.600294 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.600239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.600440 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.600380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-tls\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.602979 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.602949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9731734c-7a19-42cb-9d7b-a68c13df6505-node-exporter-tls\") pod \"node-exporter-cdxl2\" (UID: \"9731734c-7a19-42cb-9d7b-a68c13df6505\") " pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.603109 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.603056 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1828852c-70ef-4295-ad42-ce6ff2ef9842-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-j6vq9\" (UID: \"1828852c-70ef-4295-ad42-ce6ff2ef9842\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.814685 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.814647 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cdxl2" Jul 07 01:02:40.827564 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.827490 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" Jul 07 01:02:40.840378 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:40.840339 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9731734c_7a19_42cb_9d7b_a68c13df6505.slice/crio-6ce9ca1de324d593cf5e9702968f152ed2bbd0242aa776e823d5c8c9c58a5cdb WatchSource:0}: Error finding container 6ce9ca1de324d593cf5e9702968f152ed2bbd0242aa776e823d5c8c9c58a5cdb: Status 404 returned error can't find the container with id 6ce9ca1de324d593cf5e9702968f152ed2bbd0242aa776e823d5c8c9c58a5cdb Jul 07 01:02:40.949112 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.948820 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 01:02:40.969303 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.968717 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 01:02:40.969303 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.968885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:40.976575 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.972446 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 01:02:40.976575 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.973179 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 01:02:40.976575 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.973444 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 01:02:40.976575 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.973626 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 01:02:40.976575 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.973832 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 01:02:40.976575 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.974149 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 01:02:40.976575 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.974360 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 01:02:40.976575 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.974550 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 01:02:40.976575 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.974751 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 01:02:40.976575 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:40.974927 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vth6l\"" Jul 07 01:02:41.017822 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.017781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cdxl2" event={"ID":"9731734c-7a19-42cb-9d7b-a68c13df6505","Type":"ContainerStarted","Data":"6ce9ca1de324d593cf5e9702968f152ed2bbd0242aa776e823d5c8c9c58a5cdb"} Jul 07 01:02:41.021009 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.020978 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" event={"ID":"9fdf14b9-97aa-4ee6-a17a-faa4fc120060","Type":"ContainerStarted","Data":"8d81d61e7973625b27ffff1685b04092c84337009c1005cc677053b6a48d95e3"} Jul 07 01:02:41.021257 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.021236 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" event={"ID":"9fdf14b9-97aa-4ee6-a17a-faa4fc120060","Type":"ContainerStarted","Data":"7727d1dc56ee8c4a982ec13f9a47b0eff860eb6bd06f3fddfb8ab2655573118f"} Jul 07 01:02:41.021420 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.021404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" event={"ID":"9fdf14b9-97aa-4ee6-a17a-faa4fc120060","Type":"ContainerStarted","Data":"046ad52226f1990e5631262bb96025476c3e9db7fb68a265ca61a7de71852b39"} Jul 07 01:02:41.040290 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.040223 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9"] Jul 07 01:02:41.044178 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:41.044147 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1828852c_70ef_4295_ad42_ce6ff2ef9842.slice/crio-dd398d154f2dd2c2b45ea1ef9a346b7e3915a40202c2b1acf7a2f0326d254931 WatchSource:0}: Error finding container dd398d154f2dd2c2b45ea1ef9a346b7e3915a40202c2b1acf7a2f0326d254931: Status 404 returned error can't find the container with id dd398d154f2dd2c2b45ea1ef9a346b7e3915a40202c2b1acf7a2f0326d254931 Jul 07 01:02:41.103870 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.103833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.104076 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.103878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.104076 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.103904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.104076 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.103966 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.104076 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.104025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.104076 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.104062 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.104350 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.104104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-config-volume\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.104350 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.104139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xqbj\" (UniqueName: \"kubernetes.io/projected/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-kube-api-access-6xqbj\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.104350 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.104165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-config-out\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.104350 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.104203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-web-config\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.104350 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.104288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.104617 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.104365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.104617 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.104414 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.205727 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.205630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-config-volume\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.205727 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.205681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xqbj\" (UniqueName: \"kubernetes.io/projected/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-kube-api-access-6xqbj\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.205727 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.205716 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-config-out\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.206017 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.205754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-web-config\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.206017 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.205786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.206288 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.206235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.206430 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.206300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.206430 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.206361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.206430 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.206396 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.206430 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.206421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.206601 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.206471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.206601 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.206503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.206601 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.206537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.207792 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.207765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.208147 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.208119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.209005 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.208981 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.209697 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.209513 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.210471 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.210399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-config-out\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.210597 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.210531 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.211219 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.211184 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-config-volume\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.212395 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.212283 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.212832 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.212788 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.213249 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.213204 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-web-config\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.213249 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.213221 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.213415 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.213355 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.214651 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.214628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xqbj\" (UniqueName: \"kubernetes.io/projected/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-kube-api-access-6xqbj\") pod \"alertmanager-main-0\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.285692 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.285652 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:02:41.495542 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.495459 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 01:02:41.500337 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:41.500301 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6bbc3d_fdcb_4c41_a15e_2a3b37616ee8.slice/crio-32dfca6aa6b0ea92bc28dd7c9c34b9e46e7af2248aa6316f2b26591e98f608b1 WatchSource:0}: Error finding container 32dfca6aa6b0ea92bc28dd7c9c34b9e46e7af2248aa6316f2b26591e98f608b1: Status 404 returned error can't find the container with id 32dfca6aa6b0ea92bc28dd7c9c34b9e46e7af2248aa6316f2b26591e98f608b1 Jul 07 01:02:41.878883 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.878830 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p"] Jul 07 01:02:41.906028 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.905992 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p"] Jul 07 01:02:41.906215 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.906187 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:41.909924 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.909884 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4dcs142asuq6u\"" Jul 07 01:02:41.910076 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.909948 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 01:02:41.910150 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.910128 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 01:02:41.910210 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.910177 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 01:02:41.910520 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.909884 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6knrr\"" Jul 07 01:02:41.910520 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.909884 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 01:02:41.910520 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:41.910453 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 01:02:42.015222 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.015178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.015650 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.015241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrzpv\" (UniqueName: \"kubernetes.io/projected/6799d0af-716a-4618-b783-d6ef10fb7fd3-kube-api-access-zrzpv\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.015650 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.015373 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.015650 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.015429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.015650 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.015459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-grpc-tls\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.015650 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.015503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.015650 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.015533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-tls\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.015650 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.015559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6799d0af-716a-4618-b783-d6ef10fb7fd3-metrics-client-ca\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.027335 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.027296 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerStarted","Data":"32dfca6aa6b0ea92bc28dd7c9c34b9e46e7af2248aa6316f2b26591e98f608b1"} Jul 07 01:02:42.028735 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.028707 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" event={"ID":"1828852c-70ef-4295-ad42-ce6ff2ef9842","Type":"ContainerStarted","Data":"dd398d154f2dd2c2b45ea1ef9a346b7e3915a40202c2b1acf7a2f0326d254931"} Jul 07 01:02:42.116432 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.116389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzpv\" (UniqueName: \"kubernetes.io/projected/6799d0af-716a-4618-b783-d6ef10fb7fd3-kube-api-access-zrzpv\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.116671 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.116471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.116671 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.116512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.116671 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.116560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-grpc-tls\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.116671 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.116599 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.116671 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.116637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-tls\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.116671 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.116658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6799d0af-716a-4618-b783-d6ef10fb7fd3-metrics-client-ca\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.117017 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.116701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.118073 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.118038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6799d0af-716a-4618-b783-d6ef10fb7fd3-metrics-client-ca\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.119629 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.119579 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.119902 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.119874 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.120511 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.120487 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-tls\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.120625 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.120585 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.120781 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.120761 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-grpc-tls\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.121076 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.121044 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6799d0af-716a-4618-b783-d6ef10fb7fd3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.129425 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.129359 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrzpv\" (UniqueName: \"kubernetes.io/projected/6799d0af-716a-4618-b783-d6ef10fb7fd3-kube-api-access-zrzpv\") pod \"thanos-querier-6d5bfc5fbf-7qz6p\" (UID: \"6799d0af-716a-4618-b783-d6ef10fb7fd3\") " pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.221222 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.221183 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:42.606979 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:42.606945 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p"] Jul 07 01:02:42.614632 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:42.614588 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6799d0af_716a_4618_b783_d6ef10fb7fd3.slice/crio-c55f3d5e6541911c476fdc2b43a73d79455fde4518cab6b6d6594ca421176e02 WatchSource:0}: Error finding container c55f3d5e6541911c476fdc2b43a73d79455fde4518cab6b6d6594ca421176e02: Status 404 returned error can't find the container with id c55f3d5e6541911c476fdc2b43a73d79455fde4518cab6b6d6594ca421176e02 Jul 07 01:02:43.037085 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:43.036980 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" event={"ID":"6799d0af-716a-4618-b783-d6ef10fb7fd3","Type":"ContainerStarted","Data":"c55f3d5e6541911c476fdc2b43a73d79455fde4518cab6b6d6594ca421176e02"} Jul 07 01:02:43.040779 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:43.039716 2576 generic.go:356] "Generic (PLEG): container finished" podID="9731734c-7a19-42cb-9d7b-a68c13df6505" containerID="3e74dd040f51588de98ab999b5ad8a381ffba3357b2075080a6b810f1f727096" exitCode=0 Jul 07 01:02:43.040779 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:43.039770 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cdxl2" event={"ID":"9731734c-7a19-42cb-9d7b-a68c13df6505","Type":"ContainerDied","Data":"3e74dd040f51588de98ab999b5ad8a381ffba3357b2075080a6b810f1f727096"} Jul 07 01:02:44.242716 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.241182 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7cd7f95c5d-td4fq"] Jul 07 01:02:44.267173 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.267121 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cd7f95c5d-td4fq"] Jul 07 01:02:44.267451 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.267250 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.271130 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.271105 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 01:02:44.273526 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.272717 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c6uk06kjebqul\"" Jul 07 01:02:44.273526 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.272920 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 01:02:44.273526 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.272938 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 01:02:44.273526 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.273036 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jzm84\"" Jul 07 01:02:44.273526 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.273179 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 01:02:44.337417 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.337347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcda3d37-4ce0-4392-afbf-a9991d665a91-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.337417 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.337403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fcda3d37-4ce0-4392-afbf-a9991d665a91-audit-log\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.337656 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.337478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fcda3d37-4ce0-4392-afbf-a9991d665a91-metrics-server-audit-profiles\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.337656 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.337508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fcda3d37-4ce0-4392-afbf-a9991d665a91-secret-metrics-server-tls\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.337656 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.337532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcda3d37-4ce0-4392-afbf-a9991d665a91-client-ca-bundle\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.337656 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.337587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mq98\" (UniqueName: \"kubernetes.io/projected/fcda3d37-4ce0-4392-afbf-a9991d665a91-kube-api-access-6mq98\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.337859 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.337679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fcda3d37-4ce0-4392-afbf-a9991d665a91-secret-metrics-server-client-certs\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.439761 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.438883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fcda3d37-4ce0-4392-afbf-a9991d665a91-secret-metrics-server-client-certs\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.439761 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.438927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcda3d37-4ce0-4392-afbf-a9991d665a91-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.439761 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.438957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fcda3d37-4ce0-4392-afbf-a9991d665a91-audit-log\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.439761 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.439012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fcda3d37-4ce0-4392-afbf-a9991d665a91-metrics-server-audit-profiles\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.439761 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.439041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fcda3d37-4ce0-4392-afbf-a9991d665a91-secret-metrics-server-tls\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.439761 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.439064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcda3d37-4ce0-4392-afbf-a9991d665a91-client-ca-bundle\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.439761 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.439113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mq98\" (UniqueName: \"kubernetes.io/projected/fcda3d37-4ce0-4392-afbf-a9991d665a91-kube-api-access-6mq98\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.440732 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.440450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fcda3d37-4ce0-4392-afbf-a9991d665a91-metrics-server-audit-profiles\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.440732 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.440659 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcda3d37-4ce0-4392-afbf-a9991d665a91-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.440732 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.440659 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fcda3d37-4ce0-4392-afbf-a9991d665a91-audit-log\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.449496 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.449470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mq98\" (UniqueName: \"kubernetes.io/projected/fcda3d37-4ce0-4392-afbf-a9991d665a91-kube-api-access-6mq98\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.450829 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.450768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fcda3d37-4ce0-4392-afbf-a9991d665a91-secret-metrics-server-tls\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.452698 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.452671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fcda3d37-4ce0-4392-afbf-a9991d665a91-client-ca-bundle\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.454015 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.453989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fcda3d37-4ce0-4392-afbf-a9991d665a91-secret-metrics-server-client-certs\") pod \"metrics-server-7cd7f95c5d-td4fq\" (UID: \"fcda3d37-4ce0-4392-afbf-a9991d665a91\") " pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.589924 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.589840 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:02:44.697381 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.697350 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8"] Jul 07 01:02:44.710156 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.710135 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" Jul 07 01:02:44.713673 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.713646 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2cmdj\"" Jul 07 01:02:44.713841 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.713646 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 01:02:44.715170 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.715145 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8"] Jul 07 01:02:44.841603 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.841517 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/109a9497-7415-4661-b893-cefa1376342a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-klhw8\" (UID: \"109a9497-7415-4661-b893-cefa1376342a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" Jul 07 01:02:44.841603 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.841595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwcjd\" (UniqueName: \"kubernetes.io/projected/109a9497-7415-4661-b893-cefa1376342a-kube-api-access-vwcjd\") pod \"monitoring-plugin-d5dcff7cf-klhw8\" (UID: \"109a9497-7415-4661-b893-cefa1376342a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" Jul 07 01:02:44.942995 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.942951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwcjd\" (UniqueName: \"kubernetes.io/projected/109a9497-7415-4661-b893-cefa1376342a-kube-api-access-vwcjd\") pod \"monitoring-plugin-d5dcff7cf-klhw8\" (UID: \"109a9497-7415-4661-b893-cefa1376342a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" Jul 07 01:02:44.943184 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.943055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/109a9497-7415-4661-b893-cefa1376342a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-klhw8\" (UID: \"109a9497-7415-4661-b893-cefa1376342a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" Jul 07 01:02:44.946166 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.946136 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/109a9497-7415-4661-b893-cefa1376342a-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-klhw8\" (UID: \"109a9497-7415-4661-b893-cefa1376342a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" Jul 07 01:02:44.953977 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:44.953945 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwcjd\" (UniqueName: \"kubernetes.io/projected/109a9497-7415-4661-b893-cefa1376342a-kube-api-access-vwcjd\") pod \"monitoring-plugin-d5dcff7cf-klhw8\" (UID: \"109a9497-7415-4661-b893-cefa1376342a\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" Jul 07 01:02:45.021318 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.021247 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" Jul 07 01:02:45.055900 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.055866 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5847ddc64f-wlwbh"] Jul 07 01:02:45.085943 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.085910 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5847ddc64f-wlwbh"] Jul 07 01:02:45.086149 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.086044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.089211 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.088983 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 01:02:45.091212 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.090803 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gzq9l\"" Jul 07 01:02:45.091212 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.091077 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 01:02:45.092783 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.092489 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 01:02:45.092880 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.092785 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 01:02:45.093122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.092966 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 01:02:45.097959 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.097543 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 01:02:45.205501 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:45.205449 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcda3d37_4ce0_4392_afbf_a9991d665a91.slice/crio-3b4a2f3acc2126e6fc4ed0e0c6eea890bf301e65923a5e34058563889b4f5011 WatchSource:0}: Error finding container 3b4a2f3acc2126e6fc4ed0e0c6eea890bf301e65923a5e34058563889b4f5011: Status 404 returned error can't find the container with id 3b4a2f3acc2126e6fc4ed0e0c6eea890bf301e65923a5e34058563889b4f5011 Jul 07 01:02:45.206141 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.205987 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cd7f95c5d-td4fq"] Jul 07 01:02:45.245919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.245467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-serving-certs-ca-bundle\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.245919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.245509 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-telemeter-client-tls\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.245919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.245563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-secret-telemeter-client\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.245919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.245638 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-federate-client-tls\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.245919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.245684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-metrics-client-ca\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.245919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.245708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.245919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.245738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvmwh\" (UniqueName: \"kubernetes.io/projected/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-kube-api-access-vvmwh\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.245919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.245791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.265673 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.265646 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8"] Jul 07 01:02:45.348380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.346498 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvmwh\" (UniqueName: \"kubernetes.io/projected/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-kube-api-access-vvmwh\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.348380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.346564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.348380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.346605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-serving-certs-ca-bundle\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.348380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.346630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-telemeter-client-tls\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.348380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.346678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-secret-telemeter-client\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.348380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.346764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-federate-client-tls\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.348380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.346805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-metrics-client-ca\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.348380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.346833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.348380 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.347806 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.349682 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.349306 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-metrics-client-ca\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.349838 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.349817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-serving-certs-ca-bundle\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.353450 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.353403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-telemeter-client-tls\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.354038 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.354011 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.354165 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.354105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-secret-telemeter-client\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.356161 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.356119 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-federate-client-tls\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.356739 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.356716 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvmwh\" (UniqueName: \"kubernetes.io/projected/173d1b1f-9532-4d42-99fa-1f54ce8aebd6-kube-api-access-vvmwh\") pod \"telemeter-client-5847ddc64f-wlwbh\" (UID: \"173d1b1f-9532-4d42-99fa-1f54ce8aebd6\") " pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.413086 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.412916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" Jul 07 01:02:45.589640 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:45.589612 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5847ddc64f-wlwbh"] Jul 07 01:02:45.592665 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:45.592635 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173d1b1f_9532_4d42_99fa_1f54ce8aebd6.slice/crio-de44e569455ceeeece20a673f23f7da4e5284fdc72fb1a5a97da1e3c472916e2 WatchSource:0}: Error finding container de44e569455ceeeece20a673f23f7da4e5284fdc72fb1a5a97da1e3c472916e2: Status 404 returned error can't find the container with id de44e569455ceeeece20a673f23f7da4e5284fdc72fb1a5a97da1e3c472916e2 Jul 07 01:02:46.054534 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.054489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" event={"ID":"173d1b1f-9532-4d42-99fa-1f54ce8aebd6","Type":"ContainerStarted","Data":"de44e569455ceeeece20a673f23f7da4e5284fdc72fb1a5a97da1e3c472916e2"} Jul 07 01:02:46.056444 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.056414 2576 generic.go:356] "Generic (PLEG): container finished" podID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerID="dd39a105713ae6e43b1deb51ba5b6d07c0068fa7d30df55849f56d8f4abb1267" exitCode=0 Jul 07 01:02:46.056959 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.056497 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerDied","Data":"dd39a105713ae6e43b1deb51ba5b6d07c0068fa7d30df55849f56d8f4abb1267"} Jul 07 01:02:46.058045 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.057996 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" event={"ID":"109a9497-7415-4661-b893-cefa1376342a","Type":"ContainerStarted","Data":"11885a602d102710008208a2c0c031bc42dfc73a83ac7cde52b5f5628bea616c"} Jul 07 01:02:46.063824 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.063798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" event={"ID":"9fdf14b9-97aa-4ee6-a17a-faa4fc120060","Type":"ContainerStarted","Data":"fe34927d1a608610bbe2e40a5adb2942b80a64cf9f3c95d4f95652b003f4c0e0"} Jul 07 01:02:46.066538 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.066513 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cdxl2" event={"ID":"9731734c-7a19-42cb-9d7b-a68c13df6505","Type":"ContainerStarted","Data":"27f710e9d750f662e7138872a12d3b4c3ccb25f65051735062309204dec89e8c"} Jul 07 01:02:46.066655 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.066561 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cdxl2" event={"ID":"9731734c-7a19-42cb-9d7b-a68c13df6505","Type":"ContainerStarted","Data":"ddd485161f0ed80ec0579fc2e03e9822ef351c48f97fe8b158068fc642116f21"} Jul 07 01:02:46.068149 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.068124 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" event={"ID":"fcda3d37-4ce0-4392-afbf-a9991d665a91","Type":"ContainerStarted","Data":"3b4a2f3acc2126e6fc4ed0e0c6eea890bf301e65923a5e34058563889b4f5011"} Jul 07 01:02:46.070353 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.070330 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" event={"ID":"1828852c-70ef-4295-ad42-ce6ff2ef9842","Type":"ContainerStarted","Data":"1d26cc3693d19b4ea4f11192466f549a50a8ddb26316edf507e071a38936007b"} Jul 07 01:02:46.070458 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.070381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" event={"ID":"1828852c-70ef-4295-ad42-ce6ff2ef9842","Type":"ContainerStarted","Data":"8add04512592be7010f5e4849c606cd52d846a1ad73546049a8e285619d7c2c2"} Jul 07 01:02:46.070458 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.070409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" event={"ID":"1828852c-70ef-4295-ad42-ce6ff2ef9842","Type":"ContainerStarted","Data":"ff51a17f662373341205303679f8eca6904aa521a07e0e7ad984b5bb426aefe6"} Jul 07 01:02:46.110175 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.110110 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cdxl2" podStartSLOduration=5.395308117 podStartE2EDuration="7.110087626s" totalImagesPullingTime="1.589693711s" totalInitContainerRuntime="125.085798ms" isStatefulPod=true podCreationTimestamp="2026-07-07 01:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:46.108989741 +0000 UTC m=+92.115396544" watchObservedRunningTime="2026-07-07 01:02:46.110087626 +0000 UTC m=+92.116494409" Jul 07 01:02:46.136349 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.136281 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-j6vq9" podStartSLOduration=3.171066343 podStartE2EDuration="7.136242574s" totalImagesPullingTime="3.965176231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:46.133458114 +0000 UTC m=+92.139864925" watchObservedRunningTime="2026-07-07 01:02:46.136242574 +0000 UTC m=+92.142649357" Jul 07 01:02:46.136815 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.136790 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 01:02:46.153310 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.153107 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-5cl5j" podStartSLOduration=2.814093512 podStartE2EDuration="7.153090574s" totalImagesPullingTime="4.338997062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:46.152305502 +0000 UTC m=+92.158712284" watchObservedRunningTime="2026-07-07 01:02:46.153090574 +0000 UTC m=+92.159497356" Jul 07 01:02:46.170982 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.170906 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 01:02:46.171154 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.171018 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.175356 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.174325 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 01:02:46.175356 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.174618 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 01:02:46.175356 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.174801 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-68fwj\"" Jul 07 01:02:46.175356 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.174889 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 01:02:46.175356 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.175108 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 01:02:46.175356 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.175136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 01:02:46.175743 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.175702 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 01:02:46.176520 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.175865 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 01:02:46.176520 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.175955 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 01:02:46.176520 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.176170 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 01:02:46.178297 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.176999 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 01:02:46.178297 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.177153 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 01:02:46.178297 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.175875 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-49c086m4f1mtm\"" Jul 07 01:02:46.178297 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.177370 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 01:02:46.179297 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.179282 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 01:02:46.181355 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.181335 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 01:02:46.259249 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.259736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.259736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.259736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-web-config\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.259736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.259736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-config\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.259736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.259736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.259736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.259736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.259736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.259736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.259736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.260348 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.260348 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.260348 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.260348 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmtm6\" (UniqueName: \"kubernetes.io/projected/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-kube-api-access-gmtm6\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.260348 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.259976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.260348 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.260022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-config-out\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.260348 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.260066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-web-config\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-config\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361870 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.362220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.361997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmtm6\" (UniqueName: \"kubernetes.io/projected/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-kube-api-access-gmtm6\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.363101 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.362045 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.363101 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.362082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-config-out\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.363101 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.362126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.363889 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.363853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.365369 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.364353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.365485 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.365413 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.366530 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.365794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.370650 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.370131 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.370650 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.370564 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.371554 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.371476 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.372292 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.372062 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.372827 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.372474 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.376048 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.375977 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.377077 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.377035 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-config-out\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.378113 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.377858 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.378458 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.378392 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.378571 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.378492 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.378820 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.378789 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmtm6\" (UniqueName: \"kubernetes.io/projected/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-kube-api-access-gmtm6\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.379902 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.379853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.379974 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.379922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-web-config\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.380545 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.380521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.381078 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.381047 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.381183 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.381168 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-config\") pod \"prometheus-k8s-0\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.486134 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.486089 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:02:46.638280 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:46.638238 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 01:02:46.750599 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:02:46.750569 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80460e2e_b3af_48cc_9ff4_848cf29ecc4a.slice/crio-1b0c96b9824063834c8feeb5996585f124eb10e313846d9be22b93d353bce047 WatchSource:0}: Error finding container 1b0c96b9824063834c8feeb5996585f124eb10e313846d9be22b93d353bce047: Status 404 returned error can't find the container with id 1b0c96b9824063834c8feeb5996585f124eb10e313846d9be22b93d353bce047 Jul 07 01:02:47.081526 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:47.080211 2576 generic.go:356] "Generic (PLEG): container finished" podID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerID="c224039106f226f20b898491795660f9e35c3feab5325aafea0744cfd5537502" exitCode=0 Jul 07 01:02:47.081526 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:47.080343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerDied","Data":"c224039106f226f20b898491795660f9e35c3feab5325aafea0744cfd5537502"} Jul 07 01:02:47.081526 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:47.080421 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerStarted","Data":"1b0c96b9824063834c8feeb5996585f124eb10e313846d9be22b93d353bce047"} Jul 07 01:02:47.091792 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:47.090318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" event={"ID":"6799d0af-716a-4618-b783-d6ef10fb7fd3","Type":"ContainerStarted","Data":"5a46b705e3b0ed2fa3d7e73e2fac67ddd2f056e6af6d573ced6269ba5a8728e4"} Jul 07 01:02:47.091792 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:47.090424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" event={"ID":"6799d0af-716a-4618-b783-d6ef10fb7fd3","Type":"ContainerStarted","Data":"1f672e02cae1ba441be97d45a2b64f1f37ca0d1d2563f6ca9c3895d91d75f90c"} Jul 07 01:02:48.100862 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:48.100764 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" event={"ID":"6799d0af-716a-4618-b783-d6ef10fb7fd3","Type":"ContainerStarted","Data":"cdedab781e4d295c419ce83f505ee2d23bde6370ced9d730e1011023b08d75a5"} Jul 07 01:02:53.126862 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.126819 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" event={"ID":"173d1b1f-9532-4d42-99fa-1f54ce8aebd6","Type":"ContainerStarted","Data":"d35b373c532db5c05d959d7bea7a30b7e612f91e2d35d3b2e610c0f5d8194e55"} Jul 07 01:02:53.127247 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.126922 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" event={"ID":"173d1b1f-9532-4d42-99fa-1f54ce8aebd6","Type":"ContainerStarted","Data":"b7bf6aacae457b904831409f398bf4a71434767bc4a615db52f36d209241febf"} Jul 07 01:02:53.127247 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.126953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" event={"ID":"173d1b1f-9532-4d42-99fa-1f54ce8aebd6","Type":"ContainerStarted","Data":"f40a851772901487334e21a7b0b14c0ca70860693b29fe28cbb97b25c5303a87"} Jul 07 01:02:53.130525 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.130493 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerStarted","Data":"7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc"} Jul 07 01:02:53.130644 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.130580 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerStarted","Data":"38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75"} Jul 07 01:02:53.130644 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.130627 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerStarted","Data":"3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685"} Jul 07 01:02:53.130743 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.130664 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerStarted","Data":"c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891"} Jul 07 01:02:53.132688 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.131993 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" event={"ID":"109a9497-7415-4661-b893-cefa1376342a","Type":"ContainerStarted","Data":"8602c82610f7408027b8d4dcb56c349c4010a43ae87c2847454bbdf5e6b4e7b4"} Jul 07 01:02:53.132688 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.132307 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" Jul 07 01:02:53.135103 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.135049 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" event={"ID":"fcda3d37-4ce0-4392-afbf-a9991d665a91","Type":"ContainerStarted","Data":"a70c4b9a8c00dadb080f4179dbb5bcf9cbd0c21a62bedc72c1eda7576319aee9"} Jul 07 01:02:53.138915 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.138894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerStarted","Data":"38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e"} Jul 07 01:02:53.139012 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.138948 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerStarted","Data":"9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49"} Jul 07 01:02:53.139012 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.138986 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerStarted","Data":"52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d"} Jul 07 01:02:53.139115 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.139025 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerStarted","Data":"5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7"} Jul 07 01:02:53.139546 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.139525 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" Jul 07 01:02:53.141970 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.141949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" event={"ID":"6799d0af-716a-4618-b783-d6ef10fb7fd3","Type":"ContainerStarted","Data":"01216c2502ab667dd75fe61c0747699b3439c73d81b17c81ecbec20006489fdc"} Jul 07 01:02:53.142045 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.142015 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" event={"ID":"6799d0af-716a-4618-b783-d6ef10fb7fd3","Type":"ContainerStarted","Data":"33e4e78bbe0b8bf88b885784f75c9583a972f99886cd5f779d958e015e426c7e"} Jul 07 01:02:53.142085 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.142054 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" event={"ID":"6799d0af-716a-4618-b783-d6ef10fb7fd3","Type":"ContainerStarted","Data":"d258421fd905c3771f3645a93c0e1494d23691bdd1bf7d9da87299f4bbebbf05"} Jul 07 01:02:53.153283 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.150911 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5847ddc64f-wlwbh" podStartSLOduration=1.448868079 podStartE2EDuration="8.150893897s" totalImagesPullingTime="6.702025818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:53.150197423 +0000 UTC m=+99.156604226" watchObservedRunningTime="2026-07-07 01:02:53.150893897 +0000 UTC m=+99.157300679" Jul 07 01:02:53.157573 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.157463 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:53.164155 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.164131 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" Jul 07 01:02:53.173199 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.172830 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" podStartSLOduration=2.097437611 podStartE2EDuration="9.172809409s" totalImagesPullingTime="7.075371798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:53.171828433 +0000 UTC m=+99.178235216" watchObservedRunningTime="2026-07-07 01:02:53.172809409 +0000 UTC m=+99.179216192" Jul 07 01:02:53.189033 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.188975 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-klhw8" podStartSLOduration=2.197615001 podStartE2EDuration="9.188955918s" totalImagesPullingTime="6.991340917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:53.186943373 +0000 UTC m=+99.193350172" watchObservedRunningTime="2026-07-07 01:02:53.188955918 +0000 UTC m=+99.195362701" Jul 07 01:02:53.208948 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:53.208070 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d5bfc5fbf-7qz6p" podStartSLOduration=2.87422253 podStartE2EDuration="12.208048351s" totalImagesPullingTime="9.333825821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:53.207784373 +0000 UTC m=+99.214191159" watchObservedRunningTime="2026-07-07 01:02:53.208048351 +0000 UTC m=+99.214455134" Jul 07 01:02:54.149435 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:54.149391 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerStarted","Data":"216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd"} Jul 07 01:02:54.149976 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:54.149508 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerStarted","Data":"4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6"} Jul 07 01:02:54.154802 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:54.154769 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerStarted","Data":"9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953"} Jul 07 01:02:54.154960 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:54.154847 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerStarted","Data":"382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424"} Jul 07 01:02:54.179160 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:54.179094 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.366351165 podStartE2EDuration="14.179076531s" totalImagesPullingTime="9.799288641s" totalInitContainerRuntime="13.436725ms" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:54.177821323 +0000 UTC m=+100.184228131" watchObservedRunningTime="2026-07-07 01:02:54.179076531 +0000 UTC m=+100.185483313" Jul 07 01:02:54.208941 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:54.208866 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.916665929 podStartE2EDuration="8.208844081s" totalImagesPullingTime="5.266945152s" totalInitContainerRuntime="25.233ms" isStatefulPod=false podCreationTimestamp="2026-07-07 01:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:02:54.208034791 +0000 UTC m=+100.214441575" watchObservedRunningTime="2026-07-07 01:02:54.208844081 +0000 UTC m=+100.215250867" Jul 07 01:02:56.486604 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:02:56.486566 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:03:03.096180 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.096127 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f675f9fb8-82wph" podUID="4994fb0b-598c-4bd7-a36f-247894fc7253" containerName="console" containerID="cri-o://8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a" gracePeriod=15 Jul 07 01:03:03.379249 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.379219 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:03:03.431803 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.431770 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4994fb0b-598c-4bd7-a36f-247894fc7253-console-oauth-config\") pod \"4994fb0b-598c-4bd7-a36f-247894fc7253\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " Jul 07 01:03:03.431803 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.431802 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-service-ca\") pod \"4994fb0b-598c-4bd7-a36f-247894fc7253\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " Jul 07 01:03:03.432026 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.431830 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-console-config\") pod \"4994fb0b-598c-4bd7-a36f-247894fc7253\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " Jul 07 01:03:03.432026 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.431935 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4zc2\" (UniqueName: \"kubernetes.io/projected/4994fb0b-598c-4bd7-a36f-247894fc7253-kube-api-access-v4zc2\") pod \"4994fb0b-598c-4bd7-a36f-247894fc7253\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " Jul 07 01:03:03.432026 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.431969 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-oauth-serving-cert\") pod \"4994fb0b-598c-4bd7-a36f-247894fc7253\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " Jul 07 01:03:03.432026 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.431995 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4994fb0b-598c-4bd7-a36f-247894fc7253-console-serving-cert\") pod \"4994fb0b-598c-4bd7-a36f-247894fc7253\" (UID: \"4994fb0b-598c-4bd7-a36f-247894fc7253\") " Jul 07 01:03:03.432310 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.432293 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-service-ca" (OuterVolumeSpecName: "service-ca") pod "4994fb0b-598c-4bd7-a36f-247894fc7253" (UID: "4994fb0b-598c-4bd7-a36f-247894fc7253"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:03:03.432370 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.432339 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-console-config" (OuterVolumeSpecName: "console-config") pod "4994fb0b-598c-4bd7-a36f-247894fc7253" (UID: "4994fb0b-598c-4bd7-a36f-247894fc7253"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:03:03.432422 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.432383 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4994fb0b-598c-4bd7-a36f-247894fc7253" (UID: "4994fb0b-598c-4bd7-a36f-247894fc7253"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:03:03.434344 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.434309 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4994fb0b-598c-4bd7-a36f-247894fc7253-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4994fb0b-598c-4bd7-a36f-247894fc7253" (UID: "4994fb0b-598c-4bd7-a36f-247894fc7253"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:03:03.434445 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.434369 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4994fb0b-598c-4bd7-a36f-247894fc7253-kube-api-access-v4zc2" (OuterVolumeSpecName: "kube-api-access-v4zc2") pod "4994fb0b-598c-4bd7-a36f-247894fc7253" (UID: "4994fb0b-598c-4bd7-a36f-247894fc7253"). InnerVolumeSpecName "kube-api-access-v4zc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:03:03.434445 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.434385 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4994fb0b-598c-4bd7-a36f-247894fc7253-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4994fb0b-598c-4bd7-a36f-247894fc7253" (UID: "4994fb0b-598c-4bd7-a36f-247894fc7253"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:03:03.532988 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.532949 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4zc2\" (UniqueName: \"kubernetes.io/projected/4994fb0b-598c-4bd7-a36f-247894fc7253-kube-api-access-v4zc2\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:03.532988 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.532979 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-oauth-serving-cert\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:03.532988 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.532988 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4994fb0b-598c-4bd7-a36f-247894fc7253-console-serving-cert\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:03.532988 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.532996 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4994fb0b-598c-4bd7-a36f-247894fc7253-console-oauth-config\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:03.533259 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.533006 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-service-ca\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:03.533259 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:03.533014 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4994fb0b-598c-4bd7-a36f-247894fc7253-console-config\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:04.198441 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.198402 2576 generic.go:356] "Generic (PLEG): container finished" podID="4994fb0b-598c-4bd7-a36f-247894fc7253" containerID="8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a" exitCode=0 Jul 07 01:03:04.198868 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.198454 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f675f9fb8-82wph" Jul 07 01:03:04.198868 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.198495 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f675f9fb8-82wph" event={"ID":"4994fb0b-598c-4bd7-a36f-247894fc7253","Type":"ContainerDied","Data":"8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a"} Jul 07 01:03:04.198868 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.198546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f675f9fb8-82wph" event={"ID":"4994fb0b-598c-4bd7-a36f-247894fc7253","Type":"ContainerDied","Data":"a7bdae8dbb63a94cafd7bb3f2d0a1ccbfea9a50b1f59c368425e49a9ceaea6bf"} Jul 07 01:03:04.198868 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.198576 2576 scope.go:117] "RemoveContainer" containerID="8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a" Jul 07 01:03:04.212207 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.212186 2576 scope.go:117] "RemoveContainer" containerID="8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a" Jul 07 01:03:04.212551 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:03:04.212525 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a\": container with ID starting with 8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a not found: ID does not exist" containerID="8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a" Jul 07 01:03:04.212644 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.212559 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a"} err="failed to get container status \"8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a\": rpc error: code = NotFound desc = could not find container \"8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a\": container with ID starting with 8b53d64f0e02133a6dcae2766fbaa67191cf25e42b77cbce0164b4e3d265752a not found: ID does not exist" Jul 07 01:03:04.220958 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.220934 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f675f9fb8-82wph"] Jul 07 01:03:04.224019 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.223995 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f675f9fb8-82wph"] Jul 07 01:03:04.548224 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.548151 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4994fb0b-598c-4bd7-a36f-247894fc7253" path="/var/lib/kubelet/pods/4994fb0b-598c-4bd7-a36f-247894fc7253/volumes" Jul 07 01:03:04.590326 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.590291 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:03:04.590488 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.590359 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:03:04.792730 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:04.792699 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78db79756f-kml8p"] Jul 07 01:03:06.999760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:06.999723 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4f25j" Jul 07 01:03:24.596282 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:24.596235 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:03:24.600171 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:24.600149 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7cd7f95c5d-td4fq" Jul 07 01:03:29.812868 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:29.812823 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-78db79756f-kml8p" podUID="3855efd2-419d-4ad1-a5d2-7f5d65192467" containerName="console" containerID="cri-o://6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc" gracePeriod=15 Jul 07 01:03:30.058844 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.058818 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:03:30.178070 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.178039 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-config\") pod \"3855efd2-419d-4ad1-a5d2-7f5d65192467\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " Jul 07 01:03:30.178255 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.178088 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-oauth-config\") pod \"3855efd2-419d-4ad1-a5d2-7f5d65192467\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " Jul 07 01:03:30.178255 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.178118 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-trusted-ca-bundle\") pod \"3855efd2-419d-4ad1-a5d2-7f5d65192467\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " Jul 07 01:03:30.178255 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.178141 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6px2f\" (UniqueName: \"kubernetes.io/projected/3855efd2-419d-4ad1-a5d2-7f5d65192467-kube-api-access-6px2f\") pod \"3855efd2-419d-4ad1-a5d2-7f5d65192467\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " Jul 07 01:03:30.178255 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.178180 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-serving-cert\") pod \"3855efd2-419d-4ad1-a5d2-7f5d65192467\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " Jul 07 01:03:30.178255 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.178224 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-oauth-serving-cert\") pod \"3855efd2-419d-4ad1-a5d2-7f5d65192467\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " Jul 07 01:03:30.178573 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.178323 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-service-ca\") pod \"3855efd2-419d-4ad1-a5d2-7f5d65192467\" (UID: \"3855efd2-419d-4ad1-a5d2-7f5d65192467\") " Jul 07 01:03:30.178573 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.178487 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-config" (OuterVolumeSpecName: "console-config") pod "3855efd2-419d-4ad1-a5d2-7f5d65192467" (UID: "3855efd2-419d-4ad1-a5d2-7f5d65192467"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:03:30.178769 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.178746 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-config\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:30.178889 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.178778 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-service-ca" (OuterVolumeSpecName: "service-ca") pod "3855efd2-419d-4ad1-a5d2-7f5d65192467" (UID: "3855efd2-419d-4ad1-a5d2-7f5d65192467"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:03:30.178889 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.178804 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3855efd2-419d-4ad1-a5d2-7f5d65192467" (UID: "3855efd2-419d-4ad1-a5d2-7f5d65192467"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:03:30.178989 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.178898 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3855efd2-419d-4ad1-a5d2-7f5d65192467" (UID: "3855efd2-419d-4ad1-a5d2-7f5d65192467"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:03:30.180550 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.180517 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3855efd2-419d-4ad1-a5d2-7f5d65192467" (UID: "3855efd2-419d-4ad1-a5d2-7f5d65192467"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:03:30.181035 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.181008 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3855efd2-419d-4ad1-a5d2-7f5d65192467-kube-api-access-6px2f" (OuterVolumeSpecName: "kube-api-access-6px2f") pod "3855efd2-419d-4ad1-a5d2-7f5d65192467" (UID: "3855efd2-419d-4ad1-a5d2-7f5d65192467"). InnerVolumeSpecName "kube-api-access-6px2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:03:30.181035 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.181014 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3855efd2-419d-4ad1-a5d2-7f5d65192467" (UID: "3855efd2-419d-4ad1-a5d2-7f5d65192467"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:03:30.279634 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.279595 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-oauth-config\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:30.279634 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.279626 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-trusted-ca-bundle\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:30.279634 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.279637 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6px2f\" (UniqueName: \"kubernetes.io/projected/3855efd2-419d-4ad1-a5d2-7f5d65192467-kube-api-access-6px2f\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:30.279634 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.279646 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3855efd2-419d-4ad1-a5d2-7f5d65192467-console-serving-cert\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:30.279902 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.279655 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-oauth-serving-cert\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:30.279902 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.279664 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3855efd2-419d-4ad1-a5d2-7f5d65192467-service-ca\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:03:30.306341 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.306306 2576 generic.go:356] "Generic (PLEG): container finished" podID="3855efd2-419d-4ad1-a5d2-7f5d65192467" containerID="6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc" exitCode=0 Jul 07 01:03:30.306468 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.306349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78db79756f-kml8p" event={"ID":"3855efd2-419d-4ad1-a5d2-7f5d65192467","Type":"ContainerDied","Data":"6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc"} Jul 07 01:03:30.306468 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.306370 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78db79756f-kml8p" Jul 07 01:03:30.306468 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.306416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78db79756f-kml8p" event={"ID":"3855efd2-419d-4ad1-a5d2-7f5d65192467","Type":"ContainerDied","Data":"e51f25cc64c4ccbbc6c9cfdc3490aff858fc6614a18515db85cb82e22fab62d3"} Jul 07 01:03:30.306468 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.306437 2576 scope.go:117] "RemoveContainer" containerID="6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc" Jul 07 01:03:30.315325 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.315307 2576 scope.go:117] "RemoveContainer" containerID="6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc" Jul 07 01:03:30.315604 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:03:30.315585 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc\": container with ID starting with 6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc not found: ID does not exist" containerID="6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc" Jul 07 01:03:30.315674 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.315616 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc"} err="failed to get container status \"6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc\": rpc error: code = NotFound desc = could not find container \"6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc\": container with ID starting with 6b2e50c5d3fa15e17b79c8f38b9c4635876897282a5c0ec86c67674ac9e8a5fc not found: ID does not exist" Jul 07 01:03:30.327236 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.327208 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78db79756f-kml8p"] Jul 07 01:03:30.330525 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.330504 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78db79756f-kml8p"] Jul 07 01:03:30.548454 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:30.548380 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3855efd2-419d-4ad1-a5d2-7f5d65192467" path="/var/lib/kubelet/pods/3855efd2-419d-4ad1-a5d2-7f5d65192467/volumes" Jul 07 01:03:46.486653 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:46.486614 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:03:46.506534 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:46.506507 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:03:47.396555 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:03:47.396532 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:00.181120 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.181083 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 01:04:00.181680 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.181391 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="alertmanager" containerID="cri-o://c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891" gracePeriod=120 Jul 07 01:04:00.181680 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.181478 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="kube-rbac-proxy-metric" containerID="cri-o://4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6" gracePeriod=120 Jul 07 01:04:00.181680 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.181475 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="kube-rbac-proxy-web" containerID="cri-o://38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75" gracePeriod=120 Jul 07 01:04:00.181680 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.181522 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="kube-rbac-proxy" containerID="cri-o://7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc" gracePeriod=120 Jul 07 01:04:00.181680 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.181550 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="prom-label-proxy" containerID="cri-o://216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd" gracePeriod=120 Jul 07 01:04:00.181680 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.181567 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="config-reloader" containerID="cri-o://3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685" gracePeriod=120 Jul 07 01:04:00.437479 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.437396 2576 generic.go:356] "Generic (PLEG): container finished" podID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerID="216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd" exitCode=0 Jul 07 01:04:00.437479 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.437421 2576 generic.go:356] "Generic (PLEG): container finished" podID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerID="4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6" exitCode=0 Jul 07 01:04:00.437479 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.437427 2576 generic.go:356] "Generic (PLEG): container finished" podID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerID="7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc" exitCode=0 Jul 07 01:04:00.437479 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.437440 2576 generic.go:356] "Generic (PLEG): container finished" podID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerID="3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685" exitCode=0 Jul 07 01:04:00.437479 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.437445 2576 generic.go:356] "Generic (PLEG): container finished" podID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerID="c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891" exitCode=0 Jul 07 01:04:00.437738 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.437473 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerDied","Data":"216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd"} Jul 07 01:04:00.437738 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.437549 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerDied","Data":"4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6"} Jul 07 01:04:00.437738 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.437578 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerDied","Data":"7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc"} Jul 07 01:04:00.437738 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.437612 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerDied","Data":"3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685"} Jul 07 01:04:00.437738 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:00.437638 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerDied","Data":"c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891"} Jul 07 01:04:01.428276 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.428234 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.444579 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.444547 2576 generic.go:356] "Generic (PLEG): container finished" podID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerID="38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75" exitCode=0 Jul 07 01:04:01.444720 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.444633 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.444720 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.444625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerDied","Data":"38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75"} Jul 07 01:04:01.444794 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.444766 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8","Type":"ContainerDied","Data":"32dfca6aa6b0ea92bc28dd7c9c34b9e46e7af2248aa6316f2b26591e98f608b1"} Jul 07 01:04:01.444826 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.444800 2576 scope.go:117] "RemoveContainer" containerID="216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd" Jul 07 01:04:01.452375 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.452357 2576 scope.go:117] "RemoveContainer" containerID="4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6" Jul 07 01:04:01.462136 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.462091 2576 scope.go:117] "RemoveContainer" containerID="7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc" Jul 07 01:04:01.471550 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.471525 2576 scope.go:117] "RemoveContainer" containerID="38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75" Jul 07 01:04:01.479246 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.479225 2576 scope.go:117] "RemoveContainer" containerID="3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685" Jul 07 01:04:01.488579 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.488557 2576 scope.go:117] "RemoveContainer" containerID="c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891" Jul 07 01:04:01.496430 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.496356 2576 scope.go:117] "RemoveContainer" containerID="dd39a105713ae6e43b1deb51ba5b6d07c0068fa7d30df55849f56d8f4abb1267" Jul 07 01:04:01.504041 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.504020 2576 scope.go:117] "RemoveContainer" containerID="216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd" Jul 07 01:04:01.504400 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:01.504377 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd\": container with ID starting with 216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd not found: ID does not exist" containerID="216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd" Jul 07 01:04:01.504473 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.504410 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd"} err="failed to get container status \"216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd\": rpc error: code = NotFound desc = could not find container \"216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd\": container with ID starting with 216f2abdd8ed5a7c5902fa6db2c6b7c93470f26344e7724d4dc45adf41d9c4cd not found: ID does not exist" Jul 07 01:04:01.504473 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.504428 2576 scope.go:117] "RemoveContainer" containerID="4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6" Jul 07 01:04:01.504676 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:01.504654 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6\": container with ID starting with 4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6 not found: ID does not exist" containerID="4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6" Jul 07 01:04:01.504766 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.504680 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6"} err="failed to get container status \"4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6\": rpc error: code = NotFound desc = could not find container \"4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6\": container with ID starting with 4f5dc3894e160a26fe54e4859f32ab2eac62a7e6f7be30d2f6a34fd2259012c6 not found: ID does not exist" Jul 07 01:04:01.504766 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.504693 2576 scope.go:117] "RemoveContainer" containerID="7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc" Jul 07 01:04:01.504951 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:01.504935 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc\": container with ID starting with 7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc not found: ID does not exist" containerID="7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc" Jul 07 01:04:01.504990 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.504955 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc"} err="failed to get container status \"7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc\": rpc error: code = NotFound desc = could not find container \"7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc\": container with ID starting with 7abc5da7b437f92b2556154fdeee5069583eac777ee10233500493445cd5edfc not found: ID does not exist" Jul 07 01:04:01.504990 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.504969 2576 scope.go:117] "RemoveContainer" containerID="38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75" Jul 07 01:04:01.505233 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:01.505203 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75\": container with ID starting with 38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75 not found: ID does not exist" containerID="38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75" Jul 07 01:04:01.505319 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.505240 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75"} err="failed to get container status \"38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75\": rpc error: code = NotFound desc = could not find container \"38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75\": container with ID starting with 38fd3e2a914bc6eff742a0259689370c631d67f6d027911a04f18bd9a703ef75 not found: ID does not exist" Jul 07 01:04:01.505319 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.505257 2576 scope.go:117] "RemoveContainer" containerID="3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685" Jul 07 01:04:01.505618 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:01.505601 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685\": container with ID starting with 3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685 not found: ID does not exist" containerID="3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685" Jul 07 01:04:01.505717 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.505620 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685"} err="failed to get container status \"3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685\": rpc error: code = NotFound desc = could not find container \"3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685\": container with ID starting with 3e3dfac904987ceccd7c72a7a76dd24e8ee64a64361925aad91fb477bf2f0685 not found: ID does not exist" Jul 07 01:04:01.505717 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.505645 2576 scope.go:117] "RemoveContainer" containerID="c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891" Jul 07 01:04:01.505885 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:01.505863 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891\": container with ID starting with c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891 not found: ID does not exist" containerID="c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891" Jul 07 01:04:01.505926 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.505896 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891"} err="failed to get container status \"c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891\": rpc error: code = NotFound desc = could not find container \"c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891\": container with ID starting with c957755ce37364d56903010b5a80fb7b4d3d650df89ce0766e718b0f3fee8891 not found: ID does not exist" Jul 07 01:04:01.505926 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.505916 2576 scope.go:117] "RemoveContainer" containerID="dd39a105713ae6e43b1deb51ba5b6d07c0068fa7d30df55849f56d8f4abb1267" Jul 07 01:04:01.506170 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:01.506153 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd39a105713ae6e43b1deb51ba5b6d07c0068fa7d30df55849f56d8f4abb1267\": container with ID starting with dd39a105713ae6e43b1deb51ba5b6d07c0068fa7d30df55849f56d8f4abb1267 not found: ID does not exist" containerID="dd39a105713ae6e43b1deb51ba5b6d07c0068fa7d30df55849f56d8f4abb1267" Jul 07 01:04:01.506224 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.506173 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd39a105713ae6e43b1deb51ba5b6d07c0068fa7d30df55849f56d8f4abb1267"} err="failed to get container status \"dd39a105713ae6e43b1deb51ba5b6d07c0068fa7d30df55849f56d8f4abb1267\": rpc error: code = NotFound desc = could not find container \"dd39a105713ae6e43b1deb51ba5b6d07c0068fa7d30df55849f56d8f4abb1267\": container with ID starting with dd39a105713ae6e43b1deb51ba5b6d07c0068fa7d30df55849f56d8f4abb1267 not found: ID does not exist" Jul 07 01:04:01.561113 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561079 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561113 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561120 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-main-tls\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561379 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561147 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-cluster-tls-config\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561379 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561184 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-config-volume\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561379 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561210 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-config-out\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561379 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561251 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-alertmanager-trusted-ca-bundle\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561379 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561293 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-metrics-client-ca\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561379 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561317 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xqbj\" (UniqueName: \"kubernetes.io/projected/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-kube-api-access-6xqbj\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561379 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561342 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-tls-assets\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561379 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561365 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-alertmanager-main-db\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561772 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561396 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-web-config\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561772 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561421 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561772 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561457 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy-web\") pod \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\" (UID: \"4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8\") " Jul 07 01:04:01.561772 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561688 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:04:01.561772 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.561749 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-metrics-client-ca\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.562527 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.562489 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:04:01.562685 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.562665 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 01:04:01.564440 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.564399 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-kube-api-access-6xqbj" (OuterVolumeSpecName: "kube-api-access-6xqbj") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "kube-api-access-6xqbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:04:01.564600 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.564562 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-config-volume" (OuterVolumeSpecName: "config-volume") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:01.564898 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.564875 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:04:01.564995 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.564974 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:01.565663 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.565635 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:01.565795 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.565771 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:01.565880 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.565822 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:01.566117 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.566099 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-config-out" (OuterVolumeSpecName: "config-out") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 01:04:01.569661 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.569638 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:01.575963 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.575943 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-web-config" (OuterVolumeSpecName: "web-config") pod "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" (UID: "4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:01.662327 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.662293 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.662327 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.662323 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-main-tls\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.662327 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.662333 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-cluster-tls-config\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.662557 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.662342 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-config-volume\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.662557 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.662351 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-config-out\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.662557 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.662358 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.662557 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.662366 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xqbj\" (UniqueName: \"kubernetes.io/projected/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-kube-api-access-6xqbj\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.662557 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.662374 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-tls-assets\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.662557 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.662382 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-alertmanager-main-db\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.662557 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.662391 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-web-config\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.662557 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.662401 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.662557 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.662410 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:01.769561 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.769518 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 01:04:01.772994 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.772964 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 01:04:01.796174 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796148 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 01:04:01.796522 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796509 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="alertmanager" Jul 07 01:04:01.796570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796525 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="alertmanager" Jul 07 01:04:01.796570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796533 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="kube-rbac-proxy" Jul 07 01:04:01.796570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796540 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="kube-rbac-proxy" Jul 07 01:04:01.796570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796548 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="config-reloader" Jul 07 01:04:01.796570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796554 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="config-reloader" Jul 07 01:04:01.796570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796565 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="init-config-reloader" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796572 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="init-config-reloader" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796583 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="kube-rbac-proxy-metric" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796588 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="kube-rbac-proxy-metric" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796598 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4994fb0b-598c-4bd7-a36f-247894fc7253" containerName="console" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796604 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4994fb0b-598c-4bd7-a36f-247894fc7253" containerName="console" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796610 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3855efd2-419d-4ad1-a5d2-7f5d65192467" containerName="console" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796615 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3855efd2-419d-4ad1-a5d2-7f5d65192467" containerName="console" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796623 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="kube-rbac-proxy-web" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796628 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="kube-rbac-proxy-web" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796634 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="prom-label-proxy" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796642 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="prom-label-proxy" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796692 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="alertmanager" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796700 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3855efd2-419d-4ad1-a5d2-7f5d65192467" containerName="console" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796707 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="kube-rbac-proxy-web" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796715 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="prom-label-proxy" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796725 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4994fb0b-598c-4bd7-a36f-247894fc7253" containerName="console" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796733 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="config-reloader" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796739 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="kube-rbac-proxy" Jul 07 01:04:01.796740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.796746 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" containerName="kube-rbac-proxy-metric" Jul 07 01:04:01.802364 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.802336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.805387 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.805364 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vth6l\"" Jul 07 01:04:01.805476 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.805392 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 01:04:01.805476 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.805411 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 01:04:01.805476 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.805411 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 01:04:01.805629 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.805365 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 01:04:01.805629 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.805365 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 01:04:01.805813 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.805794 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 01:04:01.805934 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.805824 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 01:04:01.805934 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.805825 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 01:04:01.811448 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.811425 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 01:04:01.814093 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.814073 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 01:04:01.864160 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.864160 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864161 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-web-config\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.864381 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/714ce4b7-ffff-435e-b1b7-2749a114c166-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.864381 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/714ce4b7-ffff-435e-b1b7-2749a114c166-tls-assets\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.864381 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/714ce4b7-ffff-435e-b1b7-2749a114c166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.864381 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.864381 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.864381 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx658\" (UniqueName: \"kubernetes.io/projected/714ce4b7-ffff-435e-b1b7-2749a114c166-kube-api-access-jx658\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.864562 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-config-volume\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.864562 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.864562 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/714ce4b7-ffff-435e-b1b7-2749a114c166-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.864562 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/714ce4b7-ffff-435e-b1b7-2749a114c166-config-out\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.864562 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.864508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.965890 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.965850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx658\" (UniqueName: \"kubernetes.io/projected/714ce4b7-ffff-435e-b1b7-2749a114c166-kube-api-access-jx658\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.965890 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.965898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-config-volume\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.966168 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.965927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.966168 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.965953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/714ce4b7-ffff-435e-b1b7-2749a114c166-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.966168 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.965983 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/714ce4b7-ffff-435e-b1b7-2749a114c166-config-out\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.966168 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.966007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.966168 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.966039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.966168 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.966073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-web-config\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.966168 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.966120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/714ce4b7-ffff-435e-b1b7-2749a114c166-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.966562 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.966173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/714ce4b7-ffff-435e-b1b7-2749a114c166-tls-assets\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.966562 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.966199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/714ce4b7-ffff-435e-b1b7-2749a114c166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.966562 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.966227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.966562 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.966290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.967673 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.967356 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/714ce4b7-ffff-435e-b1b7-2749a114c166-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.967876 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.967850 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/714ce4b7-ffff-435e-b1b7-2749a114c166-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.968294 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.968249 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/714ce4b7-ffff-435e-b1b7-2749a114c166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.969986 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.969721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.970127 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.970102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.970360 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.970326 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.970463 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.970396 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.970586 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.970569 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/714ce4b7-ffff-435e-b1b7-2749a114c166-tls-assets\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.971044 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.971017 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-web-config\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.971183 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.971160 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-config-volume\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.971660 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.971639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/714ce4b7-ffff-435e-b1b7-2749a114c166-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.971940 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.971922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/714ce4b7-ffff-435e-b1b7-2749a114c166-config-out\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:01.976348 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:01.976327 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx658\" (UniqueName: \"kubernetes.io/projected/714ce4b7-ffff-435e-b1b7-2749a114c166-kube-api-access-jx658\") pod \"alertmanager-main-0\" (UID: \"714ce4b7-ffff-435e-b1b7-2749a114c166\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:02.112854 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:02.112824 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 01:04:02.253075 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:02.253046 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 01:04:02.254944 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:04:02.254907 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714ce4b7_ffff_435e_b1b7_2749a114c166.slice/crio-9a8922096e8bdfb35d87817ecf52ddc9b7a50eda6991ee154099713fad85b590 WatchSource:0}: Error finding container 9a8922096e8bdfb35d87817ecf52ddc9b7a50eda6991ee154099713fad85b590: Status 404 returned error can't find the container with id 9a8922096e8bdfb35d87817ecf52ddc9b7a50eda6991ee154099713fad85b590 Jul 07 01:04:02.451714 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:02.451611 2576 generic.go:356] "Generic (PLEG): container finished" podID="714ce4b7-ffff-435e-b1b7-2749a114c166" containerID="35f25319caf4d90799348360574fc9270d56c78d231123c1d8066687096fa563" exitCode=0 Jul 07 01:04:02.451714 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:02.451686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"714ce4b7-ffff-435e-b1b7-2749a114c166","Type":"ContainerDied","Data":"35f25319caf4d90799348360574fc9270d56c78d231123c1d8066687096fa563"} Jul 07 01:04:02.452211 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:02.451758 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"714ce4b7-ffff-435e-b1b7-2749a114c166","Type":"ContainerStarted","Data":"9a8922096e8bdfb35d87817ecf52ddc9b7a50eda6991ee154099713fad85b590"} Jul 07 01:04:02.549230 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:02.549199 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8" path="/var/lib/kubelet/pods/4a6bbc3d-fdcb-4c41-a15e-2a3b37616ee8/volumes" Jul 07 01:04:03.458548 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:03.458517 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"714ce4b7-ffff-435e-b1b7-2749a114c166","Type":"ContainerStarted","Data":"d2a81a36eaac4601636599be0bf2dcf26e69d035c7dcedfb51db4e00af59ad78"} Jul 07 01:04:03.458929 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:03.458608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"714ce4b7-ffff-435e-b1b7-2749a114c166","Type":"ContainerStarted","Data":"da8b29319218de8993477dea6d0dc4a44875b80bf7bc2134d076c21c5bff313a"} Jul 07 01:04:03.458929 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:03.458634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"714ce4b7-ffff-435e-b1b7-2749a114c166","Type":"ContainerStarted","Data":"f407472ba9b92a577535fc0aaa6afeccfb3d2ae5174597478e63ac329fe735f6"} Jul 07 01:04:03.458929 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:03.458670 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"714ce4b7-ffff-435e-b1b7-2749a114c166","Type":"ContainerStarted","Data":"e1a3ffb39391f252a9534ebb91000eff121cdf2c15cc57e637e6d9ff8ae98f21"} Jul 07 01:04:03.458929 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:03.458705 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"714ce4b7-ffff-435e-b1b7-2749a114c166","Type":"ContainerStarted","Data":"06fc10e674c9c83612bf3bebe3a2b6394a8e6c7c25c94a660de46a8f06dad656"} Jul 07 01:04:03.458929 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:03.458740 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"714ce4b7-ffff-435e-b1b7-2749a114c166","Type":"ContainerStarted","Data":"01476542c934226e139e81016f6058bc2604e8734922303d64dd9817640ee385"} Jul 07 01:04:03.485603 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:03.485539 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.469037657 podStartE2EDuration="2.485522337s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.48468ms" isStatefulPod=false podCreationTimestamp="2026-07-07 01:04:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:04:03.485137784 +0000 UTC m=+169.491544567" watchObservedRunningTime="2026-07-07 01:04:03.485522337 +0000 UTC m=+169.491929120" Jul 07 01:04:04.394777 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:04.394732 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 01:04:04.395146 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:04.395114 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="prometheus" containerID="cri-o://5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7" gracePeriod=600 Jul 07 01:04:04.395810 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:04.395476 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="kube-rbac-proxy" containerID="cri-o://382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424" gracePeriod=600 Jul 07 01:04:04.395810 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:04.395533 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="kube-rbac-proxy-web" containerID="cri-o://38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e" gracePeriod=600 Jul 07 01:04:04.395810 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:04.395643 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953" gracePeriod=600 Jul 07 01:04:04.395810 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:04.395651 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="thanos-sidecar" containerID="cri-o://9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49" gracePeriod=600 Jul 07 01:04:04.395810 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:04.395725 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="config-reloader" containerID="cri-o://52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d" gracePeriod=600 Jul 07 01:04:05.472642 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:05.472607 2576 generic.go:356] "Generic (PLEG): container finished" podID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerID="38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e" exitCode=0 Jul 07 01:04:05.472642 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:05.472639 2576 generic.go:356] "Generic (PLEG): container finished" podID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerID="9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49" exitCode=0 Jul 07 01:04:05.473064 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:05.472649 2576 generic.go:356] "Generic (PLEG): container finished" podID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerID="52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d" exitCode=0 Jul 07 01:04:05.473064 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:05.472675 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerDied","Data":"38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e"} Jul 07 01:04:05.473064 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:05.472794 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerDied","Data":"9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49"} Jul 07 01:04:05.473064 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:05.472842 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerDied","Data":"52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d"} Jul 07 01:04:06.481178 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:06.481125 2576 generic.go:356] "Generic (PLEG): container finished" podID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerID="9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953" exitCode=0 Jul 07 01:04:06.481178 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:06.481161 2576 generic.go:356] "Generic (PLEG): container finished" podID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerID="382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424" exitCode=0 Jul 07 01:04:06.481740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:06.481204 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerDied","Data":"9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953"} Jul 07 01:04:06.481740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:06.481292 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerDied","Data":"382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424"} Jul 07 01:04:07.382217 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:07.382176 2576 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 07 01:04:07.383109 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:07.383079 2576 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 07 01:04:07.383936 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:07.383906 2576 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 07 01:04:07.384007 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:07.383952 2576 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="prometheus" probeResult="unknown" Jul 07 01:04:12.381194 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:12.381153 2576 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7 is running failed: container process not found" containerID="5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 07 01:04:12.381576 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:12.381495 2576 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7 is running failed: container process not found" containerID="5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 07 01:04:12.381778 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:12.381757 2576 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7 is running failed: container process not found" containerID="5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"] Jul 07 01:04:12.381828 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:12.381788 2576 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7 is running failed: container process not found" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="prometheus" probeResult="unknown" Jul 07 01:04:12.451197 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.451173 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.510833 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.510743 2576 generic.go:356] "Generic (PLEG): container finished" podID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerID="5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7" exitCode=0 Jul 07 01:04:12.510971 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.510821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerDied","Data":"5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7"} Jul 07 01:04:12.510971 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.510834 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.510971 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.510927 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80460e2e-b3af-48cc-9ff4-848cf29ecc4a","Type":"ContainerDied","Data":"1b0c96b9824063834c8feeb5996585f124eb10e313846d9be22b93d353bce047"} Jul 07 01:04:12.510971 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.510970 2576 scope.go:117] "RemoveContainer" containerID="9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953" Jul 07 01:04:12.519297 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.519273 2576 scope.go:117] "RemoveContainer" containerID="382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424" Jul 07 01:04:12.526536 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.526515 2576 scope.go:117] "RemoveContainer" containerID="38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e" Jul 07 01:04:12.533637 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.533615 2576 scope.go:117] "RemoveContainer" containerID="9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49" Jul 07 01:04:12.540537 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.540519 2576 scope.go:117] "RemoveContainer" containerID="52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d" Jul 07 01:04:12.548420 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.548390 2576 scope.go:117] "RemoveContainer" containerID="5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7" Jul 07 01:04:12.555935 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.555921 2576 scope.go:117] "RemoveContainer" containerID="c224039106f226f20b898491795660f9e35c3feab5325aafea0744cfd5537502" Jul 07 01:04:12.562766 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.562750 2576 scope.go:117] "RemoveContainer" containerID="9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953" Jul 07 01:04:12.563034 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:12.563012 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953\": container with ID starting with 9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953 not found: ID does not exist" containerID="9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953" Jul 07 01:04:12.563119 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.563042 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953"} err="failed to get container status \"9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953\": rpc error: code = NotFound desc = could not find container \"9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953\": container with ID starting with 9f04847cb06d26b4b0e114824e77fe28065e0d35b5e9725ea493843cf60c1953 not found: ID does not exist" Jul 07 01:04:12.563119 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.563061 2576 scope.go:117] "RemoveContainer" containerID="382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424" Jul 07 01:04:12.563307 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:12.563292 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424\": container with ID starting with 382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424 not found: ID does not exist" containerID="382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424" Jul 07 01:04:12.563358 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.563311 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424"} err="failed to get container status \"382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424\": rpc error: code = NotFound desc = could not find container \"382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424\": container with ID starting with 382806bd4ec6c0ddf0ec09a6f782df26b00274d5d24e169c00037343a6ea7424 not found: ID does not exist" Jul 07 01:04:12.563358 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.563323 2576 scope.go:117] "RemoveContainer" containerID="38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e" Jul 07 01:04:12.563562 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:12.563543 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e\": container with ID starting with 38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e not found: ID does not exist" containerID="38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e" Jul 07 01:04:12.563601 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.563567 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e"} err="failed to get container status \"38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e\": rpc error: code = NotFound desc = could not find container \"38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e\": container with ID starting with 38c2dc54bb8beea758b5603c5b2b1040fdf9b6bc0d8bff0948cccfbdf9f51b3e not found: ID does not exist" Jul 07 01:04:12.563601 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.563581 2576 scope.go:117] "RemoveContainer" containerID="9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49" Jul 07 01:04:12.563800 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:12.563785 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49\": container with ID starting with 9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49 not found: ID does not exist" containerID="9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49" Jul 07 01:04:12.563841 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.563804 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49"} err="failed to get container status \"9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49\": rpc error: code = NotFound desc = could not find container \"9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49\": container with ID starting with 9e2a99c1519dc93d28a91102cbcd914a1d55301e49dc33f6d5814a4dbf69ac49 not found: ID does not exist" Jul 07 01:04:12.563841 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.563818 2576 scope.go:117] "RemoveContainer" containerID="52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d" Jul 07 01:04:12.564022 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:12.564005 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d\": container with ID starting with 52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d not found: ID does not exist" containerID="52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d" Jul 07 01:04:12.564060 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.564028 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d"} err="failed to get container status \"52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d\": rpc error: code = NotFound desc = could not find container \"52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d\": container with ID starting with 52e7445de8d13aec2d3cf3f288c1f37e949b13ce07caddfd337b40e024fa051d not found: ID does not exist" Jul 07 01:04:12.564060 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.564040 2576 scope.go:117] "RemoveContainer" containerID="5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7" Jul 07 01:04:12.564309 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:12.564255 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7\": container with ID starting with 5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7 not found: ID does not exist" containerID="5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7" Jul 07 01:04:12.564398 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.564311 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7"} err="failed to get container status \"5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7\": rpc error: code = NotFound desc = could not find container \"5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7\": container with ID starting with 5120ef504b6650b24f4bb1cc369236a0d5bbafd64683e825ba1eff18461084e7 not found: ID does not exist" Jul 07 01:04:12.564398 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.564326 2576 scope.go:117] "RemoveContainer" containerID="c224039106f226f20b898491795660f9e35c3feab5325aafea0744cfd5537502" Jul 07 01:04:12.564617 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:04:12.564583 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c224039106f226f20b898491795660f9e35c3feab5325aafea0744cfd5537502\": container with ID starting with c224039106f226f20b898491795660f9e35c3feab5325aafea0744cfd5537502 not found: ID does not exist" containerID="c224039106f226f20b898491795660f9e35c3feab5325aafea0744cfd5537502" Jul 07 01:04:12.564690 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.564623 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c224039106f226f20b898491795660f9e35c3feab5325aafea0744cfd5537502"} err="failed to get container status \"c224039106f226f20b898491795660f9e35c3feab5325aafea0744cfd5537502\": rpc error: code = NotFound desc = could not find container \"c224039106f226f20b898491795660f9e35c3feab5325aafea0744cfd5537502\": container with ID starting with c224039106f226f20b898491795660f9e35c3feab5325aafea0744cfd5537502 not found: ID does not exist" Jul 07 01:04:12.566847 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.566830 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-2\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.566898 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.566861 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-tls\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.566898 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.566891 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-web-config\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.566964 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.566917 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.566964 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.566935 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-kube-rbac-proxy\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.566964 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.566957 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567086 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.566980 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-metrics-client-ca\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567086 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567013 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-kubelet-serving-ca-bundle\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567086 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567044 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-grpc-tls\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567230 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567114 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-metrics-client-certs\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567230 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567138 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-config\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567230 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567166 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-trusted-ca-bundle\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567230 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567190 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:04:12.567230 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567224 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmtm6\" (UniqueName: \"kubernetes.io/projected/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-kube-api-access-gmtm6\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567504 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567252 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-1\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567504 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567317 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-db\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567504 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567360 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-serving-certs-ca-bundle\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567504 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567387 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-thanos-prometheus-http-client-file\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567504 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567414 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-tls-assets\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567504 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567438 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-0\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567504 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567460 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-config-out\") pod \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\" (UID: \"80460e2e-b3af-48cc-9ff4-848cf29ecc4a\") " Jul 07 01:04:12.567900 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567597 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:04:12.567900 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567774 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-metrics-client-ca\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.567900 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567795 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.568061 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567928 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:04:12.568118 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.567862 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:04:12.568752 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.568370 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:04:12.568992 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.568946 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:04:12.569351 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.569311 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:04:12.570062 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.570033 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:12.570156 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.570132 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 01:04:12.570227 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.570160 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:12.571011 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.570981 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:12.572002 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.571965 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:12.572097 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.572070 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:04:12.572166 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.572103 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:12.572423 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.572390 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:12.572559 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.572541 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-config-out" (OuterVolumeSpecName: "config-out") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 01:04:12.572708 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.572691 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-kube-api-access-gmtm6" (OuterVolumeSpecName: "kube-api-access-gmtm6") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "kube-api-access-gmtm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:04:12.573180 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.573159 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-config" (OuterVolumeSpecName: "config") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:12.573303 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.573246 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:12.582881 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.582860 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-web-config" (OuterVolumeSpecName: "web-config") pod "80460e2e-b3af-48cc-9ff4-848cf29ecc4a" (UID: "80460e2e-b3af-48cc-9ff4-848cf29ecc4a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:04:12.668432 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668393 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668432 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668424 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-web-config\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668432 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668436 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668449 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-kube-rbac-proxy\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668458 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668467 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668476 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-grpc-tls\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668484 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-secret-metrics-client-certs\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668493 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-config\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668501 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668510 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmtm6\" (UniqueName: \"kubernetes.io/projected/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-kube-api-access-gmtm6\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668519 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668529 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-db\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668539 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668548 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668555 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-tls-assets\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668563 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.668666 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.668571 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80460e2e-b3af-48cc-9ff4-848cf29ecc4a-config-out\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:04:12.836399 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.836369 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 01:04:12.840506 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.840477 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 01:04:12.865460 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865436 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 01:04:12.865740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865728 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="thanos-sidecar" Jul 07 01:04:12.865791 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865741 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="thanos-sidecar" Jul 07 01:04:12.865791 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865758 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="kube-rbac-proxy-web" Jul 07 01:04:12.865791 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865764 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="kube-rbac-proxy-web" Jul 07 01:04:12.865791 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865770 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="kube-rbac-proxy-thanos" Jul 07 01:04:12.865791 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865775 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="kube-rbac-proxy-thanos" Jul 07 01:04:12.865791 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865781 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="kube-rbac-proxy" Jul 07 01:04:12.865791 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865786 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="kube-rbac-proxy" Jul 07 01:04:12.865791 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865793 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="init-config-reloader" Jul 07 01:04:12.866024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865798 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="init-config-reloader" Jul 07 01:04:12.866024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865807 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="prometheus" Jul 07 01:04:12.866024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865812 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="prometheus" Jul 07 01:04:12.866024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865819 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="config-reloader" Jul 07 01:04:12.866024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865824 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="config-reloader" Jul 07 01:04:12.866024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865877 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="thanos-sidecar" Jul 07 01:04:12.866024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865885 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="kube-rbac-proxy-web" Jul 07 01:04:12.866024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865890 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="kube-rbac-proxy-thanos" Jul 07 01:04:12.866024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865897 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="prometheus" Jul 07 01:04:12.866024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865904 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="config-reloader" Jul 07 01:04:12.866024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.865910 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" containerName="kube-rbac-proxy" Jul 07 01:04:12.870924 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.870906 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.874110 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874083 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 01:04:12.874244 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874157 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 01:04:12.874244 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874232 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 01:04:12.874517 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874496 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 01:04:12.874646 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874627 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 01:04:12.874718 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874634 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 01:04:12.874718 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874663 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 01:04:12.874718 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874689 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 01:04:12.874718 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874696 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-68fwj\"" Jul 07 01:04:12.874896 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874636 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 01:04:12.874896 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874782 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 01:04:12.874896 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874813 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 01:04:12.875030 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874949 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-49c086m4f1mtm\"" Jul 07 01:04:12.875030 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.874973 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 01:04:12.878162 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.878144 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 01:04:12.880811 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.880714 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 01:04:12.882562 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.882540 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 01:04:12.972091 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972306 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972306 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972306 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972178 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972306 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972511 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-config\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972511 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972360 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvkbz\" (UniqueName: \"kubernetes.io/projected/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-kube-api-access-vvkbz\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972511 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972392 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972511 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972426 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972511 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972511 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972733 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972733 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-web-config\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972733 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-config-out\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972733 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972733 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972733 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972733 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972733 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:12.972733 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:12.972688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073314 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073314 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073314 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073314 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073643 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-config\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073643 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvkbz\" (UniqueName: \"kubernetes.io/projected/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-kube-api-access-vvkbz\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073643 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073643 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073643 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073643 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073643 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073551 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073643 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-web-config\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073643 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-config-out\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.073643 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073633 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.074120 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.074120 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.074120 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.074120 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.074120 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.074120 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.073815 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.074120 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.074015 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.074714 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.074151 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.074714 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.074490 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.076788 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.076432 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.076919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.076813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.076919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.076817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.076919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.076876 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.077082 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.076929 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-web-config\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.078079 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.077194 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.078079 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.077406 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.078079 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.077411 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.078079 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.077767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.078079 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.077933 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.078079 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.078035 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.078646 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.078624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-config\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.078856 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.078832 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-config-out\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.079398 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.079370 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.079688 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.079671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.080342 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.080325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.081524 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.081508 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvkbz\" (UniqueName: \"kubernetes.io/projected/c84bbca0-0a79-486a-ad5e-1c33fb2c2d19-kube-api-access-vvkbz\") pod \"prometheus-k8s-0\" (UID: \"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.182148 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.182115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:04:13.332560 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.332529 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 01:04:13.334622 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:04:13.334597 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc84bbca0_0a79_486a_ad5e_1c33fb2c2d19.slice/crio-5e3cfaf3fc24026b706f0606d9ef980887f70481f4ffb239b850fec33d5b45c7 WatchSource:0}: Error finding container 5e3cfaf3fc24026b706f0606d9ef980887f70481f4ffb239b850fec33d5b45c7: Status 404 returned error can't find the container with id 5e3cfaf3fc24026b706f0606d9ef980887f70481f4ffb239b850fec33d5b45c7 Jul 07 01:04:13.522282 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.522222 2576 generic.go:356] "Generic (PLEG): container finished" podID="c84bbca0-0a79-486a-ad5e-1c33fb2c2d19" containerID="02e47e9a81dcdcb04dd6c1dbdb5a4d31000d7cb64f793085f442b4ee51a25086" exitCode=0 Jul 07 01:04:13.522717 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.522285 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19","Type":"ContainerDied","Data":"02e47e9a81dcdcb04dd6c1dbdb5a4d31000d7cb64f793085f442b4ee51a25086"} Jul 07 01:04:13.522717 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:13.522374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19","Type":"ContainerStarted","Data":"5e3cfaf3fc24026b706f0606d9ef980887f70481f4ffb239b850fec33d5b45c7"} Jul 07 01:04:14.530425 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:14.530336 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19","Type":"ContainerStarted","Data":"ca0cf1c20a51a4d4302f9d400f8a596b3b0e5dc651b2f3aa8706adf8867e3806"} Jul 07 01:04:14.530425 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:14.530416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19","Type":"ContainerStarted","Data":"a1f9f804b4ebd02bf838926e2feeefd76e3f47f401959be1653e1abd61efc28d"} Jul 07 01:04:14.530889 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:14.530446 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19","Type":"ContainerStarted","Data":"423a2d77c77f438496ea642746062edbe9bd6a2c130a0ad941f2911760d25d02"} Jul 07 01:04:14.530889 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:14.530480 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19","Type":"ContainerStarted","Data":"024171c1176a43df8170033d3c29770a88a94f290be245f5c0bda054a53ba293"} Jul 07 01:04:14.530889 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:14.530520 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19","Type":"ContainerStarted","Data":"4a653aac7c0912d92106c88e4321a7a1b00ab67b58b13f60f5e13e04c0a83df8"} Jul 07 01:04:14.530889 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:14.530549 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c84bbca0-0a79-486a-ad5e-1c33fb2c2d19","Type":"ContainerStarted","Data":"976a863599af34c0deb95d42d30feef2ccbad1399221fcb996ac52ba2cb60af8"} Jul 07 01:04:14.547311 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:14.547279 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80460e2e-b3af-48cc-9ff4-848cf29ecc4a" path="/var/lib/kubelet/pods/80460e2e-b3af-48cc-9ff4-848cf29ecc4a/volumes" Jul 07 01:04:14.562584 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:14.562536 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5455379750000002 podStartE2EDuration="2.562520347s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.982372ms" isStatefulPod=false podCreationTimestamp="2026-07-07 01:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:04:14.559897193 +0000 UTC m=+180.566303995" watchObservedRunningTime="2026-07-07 01:04:14.562520347 +0000 UTC m=+180.568927130" Jul 07 01:04:18.183234 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:04:18.183189 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:05:13.182404 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:13.182367 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:05:13.199745 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:13.199698 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:05:13.783832 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:13.783804 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 01:05:29.179572 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.179533 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x5lxd"] Jul 07 01:05:29.182973 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.182955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x5lxd" Jul 07 01:05:29.185989 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.185969 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bfkbb\"" Jul 07 01:05:29.186097 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.185996 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 01:05:29.187746 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.187715 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 01:05:29.190478 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.190453 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x5lxd"] Jul 07 01:05:29.372442 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.372401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73f75437-e54a-40bf-ad0a-48355f2c9fb3-bound-sa-token\") pod \"cert-manager-55b4d954d5-x5lxd\" (UID: \"73f75437-e54a-40bf-ad0a-48355f2c9fb3\") " pod="cert-manager/cert-manager-55b4d954d5-x5lxd" Jul 07 01:05:29.372442 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.372439 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7ks4\" (UniqueName: \"kubernetes.io/projected/73f75437-e54a-40bf-ad0a-48355f2c9fb3-kube-api-access-m7ks4\") pod \"cert-manager-55b4d954d5-x5lxd\" (UID: \"73f75437-e54a-40bf-ad0a-48355f2c9fb3\") " pod="cert-manager/cert-manager-55b4d954d5-x5lxd" Jul 07 01:05:29.473900 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.473816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73f75437-e54a-40bf-ad0a-48355f2c9fb3-bound-sa-token\") pod \"cert-manager-55b4d954d5-x5lxd\" (UID: \"73f75437-e54a-40bf-ad0a-48355f2c9fb3\") " pod="cert-manager/cert-manager-55b4d954d5-x5lxd" Jul 07 01:05:29.473900 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.473851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7ks4\" (UniqueName: \"kubernetes.io/projected/73f75437-e54a-40bf-ad0a-48355f2c9fb3-kube-api-access-m7ks4\") pod \"cert-manager-55b4d954d5-x5lxd\" (UID: \"73f75437-e54a-40bf-ad0a-48355f2c9fb3\") " pod="cert-manager/cert-manager-55b4d954d5-x5lxd" Jul 07 01:05:29.482351 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.482315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/73f75437-e54a-40bf-ad0a-48355f2c9fb3-bound-sa-token\") pod \"cert-manager-55b4d954d5-x5lxd\" (UID: \"73f75437-e54a-40bf-ad0a-48355f2c9fb3\") " pod="cert-manager/cert-manager-55b4d954d5-x5lxd" Jul 07 01:05:29.482518 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.482495 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7ks4\" (UniqueName: \"kubernetes.io/projected/73f75437-e54a-40bf-ad0a-48355f2c9fb3-kube-api-access-m7ks4\") pod \"cert-manager-55b4d954d5-x5lxd\" (UID: \"73f75437-e54a-40bf-ad0a-48355f2c9fb3\") " pod="cert-manager/cert-manager-55b4d954d5-x5lxd" Jul 07 01:05:29.511418 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.511378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x5lxd" Jul 07 01:05:29.647076 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.647040 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x5lxd"] Jul 07 01:05:29.650091 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:05:29.650058 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73f75437_e54a_40bf_ad0a_48355f2c9fb3.slice/crio-e63314f06ca9f846260addadba7d9a1fa7f091c9ee3874abd4a346beecd6877b WatchSource:0}: Error finding container e63314f06ca9f846260addadba7d9a1fa7f091c9ee3874abd4a346beecd6877b: Status 404 returned error can't find the container with id e63314f06ca9f846260addadba7d9a1fa7f091c9ee3874abd4a346beecd6877b Jul 07 01:05:29.832916 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:29.832826 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x5lxd" event={"ID":"73f75437-e54a-40bf-ad0a-48355f2c9fb3","Type":"ContainerStarted","Data":"e63314f06ca9f846260addadba7d9a1fa7f091c9ee3874abd4a346beecd6877b"} Jul 07 01:05:32.849635 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:32.849599 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x5lxd" event={"ID":"73f75437-e54a-40bf-ad0a-48355f2c9fb3","Type":"ContainerStarted","Data":"d92e23ad16a0d2efe1a98f7397c4250f8b3636c209f4d866b92116449a71fa44"} Jul 07 01:05:32.867077 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:32.867024 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-x5lxd" podStartSLOduration=0.895121751 podStartE2EDuration="3.867006754s" totalImagesPullingTime="2.971885003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:05:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:05:32.866450773 +0000 UTC m=+258.872857554" watchObservedRunningTime="2026-07-07 01:05:32.867006754 +0000 UTC m=+258.873413535" Jul 07 01:05:52.870117 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.870030 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs"] Jul 07 01:05:52.876030 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.875993 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:52.878892 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.878864 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 01:05:52.879338 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.879318 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 01:05:52.879470 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.879385 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qqjwn\"" Jul 07 01:05:52.880742 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.880723 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 01:05:52.881415 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.881394 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 01:05:52.895023 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.894995 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs"] Jul 07 01:05:52.985598 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.985554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vk86\" (UniqueName: \"kubernetes.io/projected/6033714e-01b8-4d4d-b8ac-1995bc700d76-kube-api-access-9vk86\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:52.985598 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.985607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6033714e-01b8-4d4d-b8ac-1995bc700d76-manifests\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:52.985863 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.985708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6033714e-01b8-4d4d-b8ac-1995bc700d76-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:52.985863 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.985788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6033714e-01b8-4d4d-b8ac-1995bc700d76-tmp\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:52.985863 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:52.985812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6033714e-01b8-4d4d-b8ac-1995bc700d76-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:53.086997 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.086946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6033714e-01b8-4d4d-b8ac-1995bc700d76-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:53.087308 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.087012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vk86\" (UniqueName: \"kubernetes.io/projected/6033714e-01b8-4d4d-b8ac-1995bc700d76-kube-api-access-9vk86\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:53.087308 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.087053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6033714e-01b8-4d4d-b8ac-1995bc700d76-manifests\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:53.087308 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.087099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6033714e-01b8-4d4d-b8ac-1995bc700d76-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:53.087308 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.087164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6033714e-01b8-4d4d-b8ac-1995bc700d76-tmp\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:53.087537 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.087509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6033714e-01b8-4d4d-b8ac-1995bc700d76-manifests\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:53.094607 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.090155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6033714e-01b8-4d4d-b8ac-1995bc700d76-tmp\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:53.094607 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.090284 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6033714e-01b8-4d4d-b8ac-1995bc700d76-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:53.095369 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.095349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6033714e-01b8-4d4d-b8ac-1995bc700d76-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:53.097599 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.097579 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vk86\" (UniqueName: \"kubernetes.io/projected/6033714e-01b8-4d4d-b8ac-1995bc700d76-kube-api-access-9vk86\") pod \"opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs\" (UID: \"6033714e-01b8-4d4d-b8ac-1995bc700d76\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:53.186796 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.186709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:53.331587 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.331561 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs"] Jul 07 01:05:53.333902 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:05:53.333872 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6033714e_01b8_4d4d_b8ac_1995bc700d76.slice/crio-d0068659b731ade8ad5a2d88cce18bfe20572dea78e58ab3592dbdbc37ea7488 WatchSource:0}: Error finding container d0068659b731ade8ad5a2d88cce18bfe20572dea78e58ab3592dbdbc37ea7488: Status 404 returned error can't find the container with id d0068659b731ade8ad5a2d88cce18bfe20572dea78e58ab3592dbdbc37ea7488 Jul 07 01:05:53.938427 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:53.938395 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" event={"ID":"6033714e-01b8-4d4d-b8ac-1995bc700d76","Type":"ContainerStarted","Data":"d0068659b731ade8ad5a2d88cce18bfe20572dea78e58ab3592dbdbc37ea7488"} Jul 07 01:05:56.955992 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:56.955954 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" event={"ID":"6033714e-01b8-4d4d-b8ac-1995bc700d76","Type":"ContainerStarted","Data":"8d89ec208bfd38a9f20537aa8e8c2b35c20262ac6c2fe78f10cbeaba13fc01b1"} Jul 07 01:05:57.962448 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:57.962411 2576 generic.go:356] "Generic (PLEG): container finished" podID="6033714e-01b8-4d4d-b8ac-1995bc700d76" containerID="8d89ec208bfd38a9f20537aa8e8c2b35c20262ac6c2fe78f10cbeaba13fc01b1" exitCode=0 Jul 07 01:05:57.962909 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:57.962499 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" event={"ID":"6033714e-01b8-4d4d-b8ac-1995bc700d76","Type":"ContainerDied","Data":"8d89ec208bfd38a9f20537aa8e8c2b35c20262ac6c2fe78f10cbeaba13fc01b1"} Jul 07 01:05:58.968788 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:58.968754 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" event={"ID":"6033714e-01b8-4d4d-b8ac-1995bc700d76","Type":"ContainerStarted","Data":"e3ae39b9f48254793cbff5bb7496beb692b58c5f73fb5cdde722f0973d75ddd2"} Jul 07 01:05:58.969311 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:58.968890 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:05:58.991583 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:05:58.991523 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" podStartSLOduration=2.395631668 podStartE2EDuration="6.991507235s" totalImagesPullingTime="3.504988054s" totalInitContainerRuntime="1.090887513s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:05:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:05:58.990320938 +0000 UTC m=+284.996727821" watchObservedRunningTime="2026-07-07 01:05:58.991507235 +0000 UTC m=+284.997914017" Jul 07 01:06:09.974848 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:09.974809 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs" Jul 07 01:06:12.408857 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.408823 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv"] Jul 07 01:06:12.412430 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.412413 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.415506 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.415482 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 01:06:12.415506 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.415499 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 01:06:12.416909 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.416890 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 01:06:12.417020 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.416890 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 01:06:12.417020 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.416898 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wvx8g\"" Jul 07 01:06:12.417147 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.416901 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 01:06:12.427142 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.427111 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv"] Jul 07 01:06:12.577582 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.577547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1272039d-e3dd-4df5-9268-3b38a1c2af21-cert\") pod \"lws-controller-manager-67dff76b74-7fzkv\" (UID: \"1272039d-e3dd-4df5-9268-3b38a1c2af21\") " pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.577775 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.577592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvnpj\" (UniqueName: \"kubernetes.io/projected/1272039d-e3dd-4df5-9268-3b38a1c2af21-kube-api-access-dvnpj\") pod \"lws-controller-manager-67dff76b74-7fzkv\" (UID: \"1272039d-e3dd-4df5-9268-3b38a1c2af21\") " pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.577775 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.577657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1272039d-e3dd-4df5-9268-3b38a1c2af21-manager-config\") pod \"lws-controller-manager-67dff76b74-7fzkv\" (UID: \"1272039d-e3dd-4df5-9268-3b38a1c2af21\") " pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.577775 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.577694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1272039d-e3dd-4df5-9268-3b38a1c2af21-metrics-cert\") pod \"lws-controller-manager-67dff76b74-7fzkv\" (UID: \"1272039d-e3dd-4df5-9268-3b38a1c2af21\") " pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.678989 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.678877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1272039d-e3dd-4df5-9268-3b38a1c2af21-metrics-cert\") pod \"lws-controller-manager-67dff76b74-7fzkv\" (UID: \"1272039d-e3dd-4df5-9268-3b38a1c2af21\") " pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.679211 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.679184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1272039d-e3dd-4df5-9268-3b38a1c2af21-cert\") pod \"lws-controller-manager-67dff76b74-7fzkv\" (UID: \"1272039d-e3dd-4df5-9268-3b38a1c2af21\") " pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.679336 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.679309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvnpj\" (UniqueName: \"kubernetes.io/projected/1272039d-e3dd-4df5-9268-3b38a1c2af21-kube-api-access-dvnpj\") pod \"lws-controller-manager-67dff76b74-7fzkv\" (UID: \"1272039d-e3dd-4df5-9268-3b38a1c2af21\") " pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.679729 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.679604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1272039d-e3dd-4df5-9268-3b38a1c2af21-manager-config\") pod \"lws-controller-manager-67dff76b74-7fzkv\" (UID: \"1272039d-e3dd-4df5-9268-3b38a1c2af21\") " pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.680660 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.680636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1272039d-e3dd-4df5-9268-3b38a1c2af21-manager-config\") pod \"lws-controller-manager-67dff76b74-7fzkv\" (UID: \"1272039d-e3dd-4df5-9268-3b38a1c2af21\") " pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.681655 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.681634 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1272039d-e3dd-4df5-9268-3b38a1c2af21-metrics-cert\") pod \"lws-controller-manager-67dff76b74-7fzkv\" (UID: \"1272039d-e3dd-4df5-9268-3b38a1c2af21\") " pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.681832 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.681816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1272039d-e3dd-4df5-9268-3b38a1c2af21-cert\") pod \"lws-controller-manager-67dff76b74-7fzkv\" (UID: \"1272039d-e3dd-4df5-9268-3b38a1c2af21\") " pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.697322 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.697284 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvnpj\" (UniqueName: \"kubernetes.io/projected/1272039d-e3dd-4df5-9268-3b38a1c2af21-kube-api-access-dvnpj\") pod \"lws-controller-manager-67dff76b74-7fzkv\" (UID: \"1272039d-e3dd-4df5-9268-3b38a1c2af21\") " pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.724756 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.724721 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:12.782922 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.782753 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9b59ff655-qr574"] Jul 07 01:06:12.787284 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.787233 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" Jul 07 01:06:12.790825 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.790728 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 01:06:12.791244 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.791224 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b5nqp\"" Jul 07 01:06:12.791496 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.791468 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 01:06:12.791597 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.791523 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 01:06:12.791668 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.791631 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 01:06:12.799167 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.799112 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9b59ff655-qr574"] Jul 07 01:06:12.886166 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.886136 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv"] Jul 07 01:06:12.888910 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:06:12.888868 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1272039d_e3dd_4df5_9268_3b38a1c2af21.slice/crio-e1fd78c856451212bae7b5c722a5b60d101181544435e106ed32c4db12ff2bbd WatchSource:0}: Error finding container e1fd78c856451212bae7b5c722a5b60d101181544435e106ed32c4db12ff2bbd: Status 404 returned error can't find the container with id e1fd78c856451212bae7b5c722a5b60d101181544435e106ed32c4db12ff2bbd Jul 07 01:06:12.982024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.981922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d-tls-certs\") pod \"kube-auth-proxy-9b59ff655-qr574\" (UID: \"a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d\") " pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" Jul 07 01:06:12.982024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.981971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdnnm\" (UniqueName: \"kubernetes.io/projected/a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d-kube-api-access-vdnnm\") pod \"kube-auth-proxy-9b59ff655-qr574\" (UID: \"a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d\") " pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" Jul 07 01:06:12.982245 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:12.982037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d-tmp\") pod \"kube-auth-proxy-9b59ff655-qr574\" (UID: \"a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d\") " pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" Jul 07 01:06:13.033802 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:13.033762 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" event={"ID":"1272039d-e3dd-4df5-9268-3b38a1c2af21","Type":"ContainerStarted","Data":"e1fd78c856451212bae7b5c722a5b60d101181544435e106ed32c4db12ff2bbd"} Jul 07 01:06:13.083427 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:13.083384 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d-tls-certs\") pod \"kube-auth-proxy-9b59ff655-qr574\" (UID: \"a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d\") " pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" Jul 07 01:06:13.083619 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:13.083440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdnnm\" (UniqueName: \"kubernetes.io/projected/a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d-kube-api-access-vdnnm\") pod \"kube-auth-proxy-9b59ff655-qr574\" (UID: \"a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d\") " pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" Jul 07 01:06:13.083619 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:13.083469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d-tmp\") pod \"kube-auth-proxy-9b59ff655-qr574\" (UID: \"a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d\") " pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" Jul 07 01:06:13.086182 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:13.086140 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d-tmp\") pod \"kube-auth-proxy-9b59ff655-qr574\" (UID: \"a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d\") " pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" Jul 07 01:06:13.086426 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:13.086406 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d-tls-certs\") pod \"kube-auth-proxy-9b59ff655-qr574\" (UID: \"a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d\") " pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" Jul 07 01:06:13.094341 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:13.094300 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdnnm\" (UniqueName: \"kubernetes.io/projected/a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d-kube-api-access-vdnnm\") pod \"kube-auth-proxy-9b59ff655-qr574\" (UID: \"a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d\") " pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" Jul 07 01:06:13.109335 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:13.109295 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" Jul 07 01:06:13.269245 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:13.269217 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9b59ff655-qr574"] Jul 07 01:06:13.271358 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:06:13.271323 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42ebd9c_f46a_4211_8f7e_28cf4f1cb33d.slice/crio-d8a1ad1182470da2c658c5d214b0eb43cf2ae64b1628a80d5842938b10ac5798 WatchSource:0}: Error finding container d8a1ad1182470da2c658c5d214b0eb43cf2ae64b1628a80d5842938b10ac5798: Status 404 returned error can't find the container with id d8a1ad1182470da2c658c5d214b0eb43cf2ae64b1628a80d5842938b10ac5798 Jul 07 01:06:14.041830 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:14.041788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" event={"ID":"a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d","Type":"ContainerStarted","Data":"d8a1ad1182470da2c658c5d214b0eb43cf2ae64b1628a80d5842938b10ac5798"} Jul 07 01:06:14.500432 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:14.500203 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 01:06:16.986091 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:16.986029 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 01:06:18.071575 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:18.071526 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" event={"ID":"1272039d-e3dd-4df5-9268-3b38a1c2af21","Type":"ContainerStarted","Data":"6d93f99bb2fb6e7fcb038701a50a64505e4a0906157dd122dd5080d83e264064"} Jul 07 01:06:18.072090 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:18.071635 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:06:18.073175 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:18.073150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" event={"ID":"a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d","Type":"ContainerStarted","Data":"154ee6e444f53b6e15d0c4530c985efc36430ed1bbd87df77b9cca42f37e1dcb"} Jul 07 01:06:18.089351 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:18.089293 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" podStartSLOduration=1.998979291 podStartE2EDuration="6.089276109s" totalImagesPullingTime="4.090296818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:06:18.087730246 +0000 UTC m=+304.094137047" watchObservedRunningTime="2026-07-07 01:06:18.089276109 +0000 UTC m=+304.095682884" Jul 07 01:06:18.104803 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:18.104738 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9b59ff655-qr574" podStartSLOduration=2.395017426 podStartE2EDuration="6.104721057s" totalImagesPullingTime="3.709703631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:06:18.103537867 +0000 UTC m=+304.109944649" watchObservedRunningTime="2026-07-07 01:06:18.104721057 +0000 UTC m=+304.111127839" Jul 07 01:06:29.081796 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:06:29.081757 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67dff76b74-7fzkv" Jul 07 01:07:59.472393 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.472362 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59b47bf766-86fx7"] Jul 07 01:07:59.475826 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.475809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.478727 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.478705 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rcjg8\"" Jul 07 01:07:59.478852 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.478733 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 01:07:59.478852 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.478786 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 01:07:59.480147 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.480127 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 01:07:59.480319 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.480303 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 01:07:59.480374 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.480319 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 01:07:59.489835 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.489806 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b47bf766-86fx7"] Jul 07 01:07:59.493315 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.493292 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 01:07:59.560569 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.560538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6544e2-7a10-4932-a5b3-dfd45bf52005-console-oauth-config\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.560569 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.560577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6544e2-7a10-4932-a5b3-dfd45bf52005-console-serving-cert\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.560803 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.560592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6544e2-7a10-4932-a5b3-dfd45bf52005-trusted-ca-bundle\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.560803 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.560639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6544e2-7a10-4932-a5b3-dfd45bf52005-service-ca\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.560803 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.560670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h7j8\" (UniqueName: \"kubernetes.io/projected/4e6544e2-7a10-4932-a5b3-dfd45bf52005-kube-api-access-5h7j8\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.560803 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.560691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e6544e2-7a10-4932-a5b3-dfd45bf52005-console-config\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.560803 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.560760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6544e2-7a10-4932-a5b3-dfd45bf52005-oauth-serving-cert\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.661989 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.661954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6544e2-7a10-4932-a5b3-dfd45bf52005-console-oauth-config\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.661989 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.661992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6544e2-7a10-4932-a5b3-dfd45bf52005-console-serving-cert\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.662241 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.662009 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6544e2-7a10-4932-a5b3-dfd45bf52005-trusted-ca-bundle\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.662241 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.662042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6544e2-7a10-4932-a5b3-dfd45bf52005-service-ca\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.662241 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.662078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h7j8\" (UniqueName: \"kubernetes.io/projected/4e6544e2-7a10-4932-a5b3-dfd45bf52005-kube-api-access-5h7j8\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.662241 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.662099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e6544e2-7a10-4932-a5b3-dfd45bf52005-console-config\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.662241 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.662142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6544e2-7a10-4932-a5b3-dfd45bf52005-oauth-serving-cert\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.662908 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.662886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e6544e2-7a10-4932-a5b3-dfd45bf52005-console-config\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.663024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.662990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e6544e2-7a10-4932-a5b3-dfd45bf52005-oauth-serving-cert\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.663181 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.663157 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e6544e2-7a10-4932-a5b3-dfd45bf52005-service-ca\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.663346 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.663322 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e6544e2-7a10-4932-a5b3-dfd45bf52005-trusted-ca-bundle\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.664800 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.664773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e6544e2-7a10-4932-a5b3-dfd45bf52005-console-oauth-config\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.664913 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.664854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e6544e2-7a10-4932-a5b3-dfd45bf52005-console-serving-cert\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.671286 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.671237 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h7j8\" (UniqueName: \"kubernetes.io/projected/4e6544e2-7a10-4932-a5b3-dfd45bf52005-kube-api-access-5h7j8\") pod \"console-59b47bf766-86fx7\" (UID: \"4e6544e2-7a10-4932-a5b3-dfd45bf52005\") " pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.787101 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.787011 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:07:59.929344 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:07:59.929318 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b47bf766-86fx7"] Jul 07 01:07:59.931177 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:07:59.931148 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6544e2_7a10_4932_a5b3_dfd45bf52005.slice/crio-f0e5876d03b6c159ae73ffd4ad5b2287e68e4fce735a3d37535821db50712c65 WatchSource:0}: Error finding container f0e5876d03b6c159ae73ffd4ad5b2287e68e4fce735a3d37535821db50712c65: Status 404 returned error can't find the container with id f0e5876d03b6c159ae73ffd4ad5b2287e68e4fce735a3d37535821db50712c65 Jul 07 01:08:00.565157 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:00.565123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b47bf766-86fx7" event={"ID":"4e6544e2-7a10-4932-a5b3-dfd45bf52005","Type":"ContainerStarted","Data":"350182d7419fc8a34fea262e0562832dacd8e8c15afe390b1593c862fd570107"} Jul 07 01:08:00.565615 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:00.565167 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b47bf766-86fx7" event={"ID":"4e6544e2-7a10-4932-a5b3-dfd45bf52005","Type":"ContainerStarted","Data":"f0e5876d03b6c159ae73ffd4ad5b2287e68e4fce735a3d37535821db50712c65"} Jul 07 01:08:00.583860 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:00.583817 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59b47bf766-86fx7" podStartSLOduration=1.583802884 podStartE2EDuration="1.583802884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:07:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:08:00.582150151 +0000 UTC m=+406.588556958" watchObservedRunningTime="2026-07-07 01:08:00.583802884 +0000 UTC m=+406.590209666" Jul 07 01:08:09.787751 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:09.787708 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:08:09.788159 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:09.787792 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:08:09.792508 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:09.792484 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:08:10.613959 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:10.613927 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59b47bf766-86fx7" Jul 07 01:08:36.989298 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:36.989188 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2"] Jul 07 01:08:36.992535 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:36.992519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:36.996969 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:36.996945 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 01:08:36.997314 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:36.997297 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 01:08:36.997367 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:36.997339 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dvc5k\"" Jul 07 01:08:37.004111 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.004088 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2"] Jul 07 01:08:37.012071 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.012046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/876989aa-4b67-4ff5-a51a-fc32befe5845-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8cgf2\" (UID: \"876989aa-4b67-4ff5-a51a-fc32befe5845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:37.012176 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.012080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md2p7\" (UniqueName: \"kubernetes.io/projected/876989aa-4b67-4ff5-a51a-fc32befe5845-kube-api-access-md2p7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8cgf2\" (UID: \"876989aa-4b67-4ff5-a51a-fc32befe5845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:37.112824 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.112793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/876989aa-4b67-4ff5-a51a-fc32befe5845-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8cgf2\" (UID: \"876989aa-4b67-4ff5-a51a-fc32befe5845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:37.112824 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.112827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md2p7\" (UniqueName: \"kubernetes.io/projected/876989aa-4b67-4ff5-a51a-fc32befe5845-kube-api-access-md2p7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8cgf2\" (UID: \"876989aa-4b67-4ff5-a51a-fc32befe5845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:37.113210 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.113191 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/876989aa-4b67-4ff5-a51a-fc32befe5845-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8cgf2\" (UID: \"876989aa-4b67-4ff5-a51a-fc32befe5845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:37.123874 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.123848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md2p7\" (UniqueName: \"kubernetes.io/projected/876989aa-4b67-4ff5-a51a-fc32befe5845-kube-api-access-md2p7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-8cgf2\" (UID: \"876989aa-4b67-4ff5-a51a-fc32befe5845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:37.303789 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.303706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:37.437218 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.437194 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2"] Jul 07 01:08:37.439226 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:08:37.439201 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876989aa_4b67_4ff5_a51a_fc32befe5845.slice/crio-3cf6aed5d2b8717d66a1129284b6c16e3128f5ae5387f91a5112a0c635f12479 WatchSource:0}: Error finding container 3cf6aed5d2b8717d66a1129284b6c16e3128f5ae5387f91a5112a0c635f12479: Status 404 returned error can't find the container with id 3cf6aed5d2b8717d66a1129284b6c16e3128f5ae5387f91a5112a0c635f12479 Jul 07 01:08:37.441780 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.441765 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 01:08:37.734892 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.734858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" event={"ID":"876989aa-4b67-4ff5-a51a-fc32befe5845","Type":"ContainerStarted","Data":"3cf6aed5d2b8717d66a1129284b6c16e3128f5ae5387f91a5112a0c635f12479"} Jul 07 01:08:37.768604 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.768578 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2"] Jul 07 01:08:37.869682 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.869650 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2"] Jul 07 01:08:37.903074 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.903039 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb"] Jul 07 01:08:37.906466 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.906447 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" Jul 07 01:08:37.919413 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.919388 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb"] Jul 07 01:08:37.920455 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.920427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckftq\" (UniqueName: \"kubernetes.io/projected/29572631-8580-4170-bea1-1c3e6df33b56-kube-api-access-ckftq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zrztb\" (UID: \"29572631-8580-4170-bea1-1c3e6df33b56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" Jul 07 01:08:37.920572 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:37.920477 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29572631-8580-4170-bea1-1c3e6df33b56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zrztb\" (UID: \"29572631-8580-4170-bea1-1c3e6df33b56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" Jul 07 01:08:38.023917 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:38.021948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckftq\" (UniqueName: \"kubernetes.io/projected/29572631-8580-4170-bea1-1c3e6df33b56-kube-api-access-ckftq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zrztb\" (UID: \"29572631-8580-4170-bea1-1c3e6df33b56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" Jul 07 01:08:38.023917 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:38.022047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29572631-8580-4170-bea1-1c3e6df33b56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zrztb\" (UID: \"29572631-8580-4170-bea1-1c3e6df33b56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" Jul 07 01:08:38.023917 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:38.022573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29572631-8580-4170-bea1-1c3e6df33b56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zrztb\" (UID: \"29572631-8580-4170-bea1-1c3e6df33b56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" Jul 07 01:08:38.033486 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:38.033450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckftq\" (UniqueName: \"kubernetes.io/projected/29572631-8580-4170-bea1-1c3e6df33b56-kube-api-access-ckftq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zrztb\" (UID: \"29572631-8580-4170-bea1-1c3e6df33b56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" Jul 07 01:08:38.220339 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:38.220304 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" Jul 07 01:08:38.727540 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:38.727509 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb"] Jul 07 01:08:38.727997 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:08:38.727967 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29572631_8580_4170_bea1_1c3e6df33b56.slice/crio-31ae1e845d3a482b02e884d6ee20dc94bfccb9f03d38daa5fe95dbc681cd23a0 WatchSource:0}: Error finding container 31ae1e845d3a482b02e884d6ee20dc94bfccb9f03d38daa5fe95dbc681cd23a0: Status 404 returned error can't find the container with id 31ae1e845d3a482b02e884d6ee20dc94bfccb9f03d38daa5fe95dbc681cd23a0 Jul 07 01:08:38.740995 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:38.740969 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" event={"ID":"29572631-8580-4170-bea1-1c3e6df33b56","Type":"ContainerStarted","Data":"31ae1e845d3a482b02e884d6ee20dc94bfccb9f03d38daa5fe95dbc681cd23a0"} Jul 07 01:08:43.767840 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:43.767807 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" event={"ID":"29572631-8580-4170-bea1-1c3e6df33b56","Type":"ContainerStarted","Data":"c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572"} Jul 07 01:08:43.768340 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:43.767917 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" Jul 07 01:08:43.769801 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:43.769775 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" podUID="876989aa-4b67-4ff5-a51a-fc32befe5845" containerName="manager" containerID="cri-o://8e991a56d63da2fe610cae13b9d9ba8039ba47aaf15fadd28b8656a8cfdd85b6" gracePeriod=2 Jul 07 01:08:43.791004 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:43.790947 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" podStartSLOduration=2.3205968009999998 podStartE2EDuration="6.790927537s" totalImagesPullingTime="4.470330736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:08:43.786801788 +0000 UTC m=+449.793208569" watchObservedRunningTime="2026-07-07 01:08:43.790927537 +0000 UTC m=+449.797334319" Jul 07 01:08:44.018591 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.018535 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:44.021152 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:08:44.021109 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8cgf2\" is forbidden: User \"system:node:ip-10-0-130-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-147.ec2.internal' and this object" podUID="876989aa-4b67-4ff5-a51a-fc32befe5845" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:44.084427 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.084401 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/876989aa-4b67-4ff5-a51a-fc32befe5845-extensions-socket-volume\") pod \"876989aa-4b67-4ff5-a51a-fc32befe5845\" (UID: \"876989aa-4b67-4ff5-a51a-fc32befe5845\") " Jul 07 01:08:44.084567 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.084461 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md2p7\" (UniqueName: \"kubernetes.io/projected/876989aa-4b67-4ff5-a51a-fc32befe5845-kube-api-access-md2p7\") pod \"876989aa-4b67-4ff5-a51a-fc32befe5845\" (UID: \"876989aa-4b67-4ff5-a51a-fc32befe5845\") " Jul 07 01:08:44.084685 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.084661 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876989aa-4b67-4ff5-a51a-fc32befe5845-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "876989aa-4b67-4ff5-a51a-fc32befe5845" (UID: "876989aa-4b67-4ff5-a51a-fc32befe5845"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 01:08:44.086702 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.086683 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/876989aa-4b67-4ff5-a51a-fc32befe5845-kube-api-access-md2p7" (OuterVolumeSpecName: "kube-api-access-md2p7") pod "876989aa-4b67-4ff5-a51a-fc32befe5845" (UID: "876989aa-4b67-4ff5-a51a-fc32befe5845"). InnerVolumeSpecName "kube-api-access-md2p7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:08:44.185969 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.185936 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/876989aa-4b67-4ff5-a51a-fc32befe5845-extensions-socket-volume\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:08:44.185969 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.185964 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md2p7\" (UniqueName: \"kubernetes.io/projected/876989aa-4b67-4ff5-a51a-fc32befe5845-kube-api-access-md2p7\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:08:44.554083 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.554044 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="876989aa-4b67-4ff5-a51a-fc32befe5845" path="/var/lib/kubelet/pods/876989aa-4b67-4ff5-a51a-fc32befe5845/volumes" Jul 07 01:08:44.554254 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:08:44.554098 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8cgf2\" is forbidden: User \"system:node:ip-10-0-130-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-147.ec2.internal' and this object" podUID="876989aa-4b67-4ff5-a51a-fc32befe5845" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:44.776156 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.776124 2576 generic.go:356] "Generic (PLEG): container finished" podID="876989aa-4b67-4ff5-a51a-fc32befe5845" containerID="8e991a56d63da2fe610cae13b9d9ba8039ba47aaf15fadd28b8656a8cfdd85b6" exitCode=2 Jul 07 01:08:44.776596 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.776162 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:44.776596 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.776218 2576 scope.go:117] "RemoveContainer" containerID="8e991a56d63da2fe610cae13b9d9ba8039ba47aaf15fadd28b8656a8cfdd85b6" Jul 07 01:08:44.781305 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:08:44.781277 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-8cgf2\" is forbidden: User \"system:node:ip-10-0-130-147.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-147.ec2.internal' and this object" podUID="876989aa-4b67-4ff5-a51a-fc32befe5845" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-8cgf2" Jul 07 01:08:44.785902 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.785886 2576 scope.go:117] "RemoveContainer" containerID="8e991a56d63da2fe610cae13b9d9ba8039ba47aaf15fadd28b8656a8cfdd85b6" Jul 07 01:08:44.786170 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:08:44.786150 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e991a56d63da2fe610cae13b9d9ba8039ba47aaf15fadd28b8656a8cfdd85b6\": container with ID starting with 8e991a56d63da2fe610cae13b9d9ba8039ba47aaf15fadd28b8656a8cfdd85b6 not found: ID does not exist" containerID="8e991a56d63da2fe610cae13b9d9ba8039ba47aaf15fadd28b8656a8cfdd85b6" Jul 07 01:08:44.786239 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:44.786184 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e991a56d63da2fe610cae13b9d9ba8039ba47aaf15fadd28b8656a8cfdd85b6"} err="failed to get container status \"8e991a56d63da2fe610cae13b9d9ba8039ba47aaf15fadd28b8656a8cfdd85b6\": rpc error: code = NotFound desc = could not find container \"8e991a56d63da2fe610cae13b9d9ba8039ba47aaf15fadd28b8656a8cfdd85b6\": container with ID starting with 8e991a56d63da2fe610cae13b9d9ba8039ba47aaf15fadd28b8656a8cfdd85b6 not found: ID does not exist" Jul 07 01:08:50.190590 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.190557 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb"] Jul 07 01:08:50.191458 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.191396 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" podUID="29572631-8580-4170-bea1-1c3e6df33b56" containerName="manager" containerID="cri-o://c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572" gracePeriod=10 Jul 07 01:08:50.193797 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.193764 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" Jul 07 01:08:50.447905 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.447846 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" Jul 07 01:08:50.543043 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.543019 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckftq\" (UniqueName: \"kubernetes.io/projected/29572631-8580-4170-bea1-1c3e6df33b56-kube-api-access-ckftq\") pod \"29572631-8580-4170-bea1-1c3e6df33b56\" (UID: \"29572631-8580-4170-bea1-1c3e6df33b56\") " Jul 07 01:08:50.543210 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.543120 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29572631-8580-4170-bea1-1c3e6df33b56-extensions-socket-volume\") pod \"29572631-8580-4170-bea1-1c3e6df33b56\" (UID: \"29572631-8580-4170-bea1-1c3e6df33b56\") " Jul 07 01:08:50.543715 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.543685 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29572631-8580-4170-bea1-1c3e6df33b56-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "29572631-8580-4170-bea1-1c3e6df33b56" (UID: "29572631-8580-4170-bea1-1c3e6df33b56"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 01:08:50.545303 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.545283 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29572631-8580-4170-bea1-1c3e6df33b56-kube-api-access-ckftq" (OuterVolumeSpecName: "kube-api-access-ckftq") pod "29572631-8580-4170-bea1-1c3e6df33b56" (UID: "29572631-8580-4170-bea1-1c3e6df33b56"). InnerVolumeSpecName "kube-api-access-ckftq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:08:50.644280 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.644244 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckftq\" (UniqueName: \"kubernetes.io/projected/29572631-8580-4170-bea1-1c3e6df33b56-kube-api-access-ckftq\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:08:50.644437 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.644293 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29572631-8580-4170-bea1-1c3e6df33b56-extensions-socket-volume\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:08:50.807024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.806941 2576 generic.go:356] "Generic (PLEG): container finished" podID="29572631-8580-4170-bea1-1c3e6df33b56" containerID="c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572" exitCode=0 Jul 07 01:08:50.807024 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.806985 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" Jul 07 01:08:50.807206 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.807019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" event={"ID":"29572631-8580-4170-bea1-1c3e6df33b56","Type":"ContainerDied","Data":"c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572"} Jul 07 01:08:50.807206 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.807071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb" event={"ID":"29572631-8580-4170-bea1-1c3e6df33b56","Type":"ContainerDied","Data":"31ae1e845d3a482b02e884d6ee20dc94bfccb9f03d38daa5fe95dbc681cd23a0"} Jul 07 01:08:50.807206 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.807093 2576 scope.go:117] "RemoveContainer" containerID="c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572" Jul 07 01:08:50.815855 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.815841 2576 scope.go:117] "RemoveContainer" containerID="c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572" Jul 07 01:08:50.816063 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:08:50.816044 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572\": container with ID starting with c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572 not found: ID does not exist" containerID="c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572" Jul 07 01:08:50.816114 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.816077 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572"} err="failed to get container status \"c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572\": rpc error: code = NotFound desc = could not find container \"c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572\": container with ID starting with c65f5bd04a1e9ec8bf0f4f4b258c62982ba170d1154904a3257515f5fe71a572 not found: ID does not exist" Jul 07 01:08:50.828240 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.828219 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb"] Jul 07 01:08:50.835858 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:50.835839 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zrztb"] Jul 07 01:08:52.548721 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:08:52.548689 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29572631-8580-4170-bea1-1c3e6df33b56" path="/var/lib/kubelet/pods/29572631-8580-4170-bea1-1c3e6df33b56/volumes" Jul 07 01:09:22.753694 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.753658 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h4hbb"] Jul 07 01:09:22.754096 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.754013 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29572631-8580-4170-bea1-1c3e6df33b56" containerName="manager" Jul 07 01:09:22.754096 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.754024 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="29572631-8580-4170-bea1-1c3e6df33b56" containerName="manager" Jul 07 01:09:22.754096 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.754044 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="876989aa-4b67-4ff5-a51a-fc32befe5845" containerName="manager" Jul 07 01:09:22.754096 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.754049 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="876989aa-4b67-4ff5-a51a-fc32befe5845" containerName="manager" Jul 07 01:09:22.754237 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.754117 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="29572631-8580-4170-bea1-1c3e6df33b56" containerName="manager" Jul 07 01:09:22.754237 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.754124 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="876989aa-4b67-4ff5-a51a-fc32befe5845" containerName="manager" Jul 07 01:09:22.758497 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.758480 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" Jul 07 01:09:22.761393 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.761366 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 01:09:22.761504 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.761425 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 01:09:22.761504 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.761371 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 01:09:22.762948 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.762915 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mmqgp\"" Jul 07 01:09:22.765887 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.765866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h4hbb"] Jul 07 01:09:22.836543 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.836511 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2pgj\" (UniqueName: \"kubernetes.io/projected/e1c1e4ff-8053-47da-bca6-d60e91ed16d4-kube-api-access-k2pgj\") pod \"limitador-limitador-64c94fd64f-h4hbb\" (UID: \"e1c1e4ff-8053-47da-bca6-d60e91ed16d4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" Jul 07 01:09:22.836725 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.836567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1c1e4ff-8053-47da-bca6-d60e91ed16d4-config-file\") pod \"limitador-limitador-64c94fd64f-h4hbb\" (UID: \"e1c1e4ff-8053-47da-bca6-d60e91ed16d4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" Jul 07 01:09:22.844370 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.844337 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h4hbb"] Jul 07 01:09:22.937722 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.937690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2pgj\" (UniqueName: \"kubernetes.io/projected/e1c1e4ff-8053-47da-bca6-d60e91ed16d4-kube-api-access-k2pgj\") pod \"limitador-limitador-64c94fd64f-h4hbb\" (UID: \"e1c1e4ff-8053-47da-bca6-d60e91ed16d4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" Jul 07 01:09:22.937881 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.937729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1c1e4ff-8053-47da-bca6-d60e91ed16d4-config-file\") pod \"limitador-limitador-64c94fd64f-h4hbb\" (UID: \"e1c1e4ff-8053-47da-bca6-d60e91ed16d4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" Jul 07 01:09:22.938422 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.938404 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1c1e4ff-8053-47da-bca6-d60e91ed16d4-config-file\") pod \"limitador-limitador-64c94fd64f-h4hbb\" (UID: \"e1c1e4ff-8053-47da-bca6-d60e91ed16d4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" Jul 07 01:09:22.948464 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:22.948437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2pgj\" (UniqueName: \"kubernetes.io/projected/e1c1e4ff-8053-47da-bca6-d60e91ed16d4-kube-api-access-k2pgj\") pod \"limitador-limitador-64c94fd64f-h4hbb\" (UID: \"e1c1e4ff-8053-47da-bca6-d60e91ed16d4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" Jul 07 01:09:23.068710 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:23.068618 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" Jul 07 01:09:23.208605 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:23.208292 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h4hbb"] Jul 07 01:09:23.212140 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:09:23.212113 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c1e4ff_8053_47da_bca6_d60e91ed16d4.slice/crio-a7ae09ed0bdd90f9ce1ceca6ff7d45da6977c969d3d480bc90d1139e87c17873 WatchSource:0}: Error finding container a7ae09ed0bdd90f9ce1ceca6ff7d45da6977c969d3d480bc90d1139e87c17873: Status 404 returned error can't find the container with id a7ae09ed0bdd90f9ce1ceca6ff7d45da6977c969d3d480bc90d1139e87c17873 Jul 07 01:09:23.535341 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:23.535309 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-bzktq"] Jul 07 01:09:23.540078 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:23.540054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bzktq" Jul 07 01:09:23.542661 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:23.542641 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-97xpr\"" Jul 07 01:09:23.548060 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:23.548035 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bzktq"] Jul 07 01:09:23.643758 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:23.643723 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4g9q\" (UniqueName: \"kubernetes.io/projected/f7be25ae-21fc-427e-b814-c59bcf4f6502-kube-api-access-q4g9q\") pod \"authorino-58cd955675-bzktq\" (UID: \"f7be25ae-21fc-427e-b814-c59bcf4f6502\") " pod="kuadrant-system/authorino-58cd955675-bzktq" Jul 07 01:09:23.745258 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:23.745219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4g9q\" (UniqueName: \"kubernetes.io/projected/f7be25ae-21fc-427e-b814-c59bcf4f6502-kube-api-access-q4g9q\") pod \"authorino-58cd955675-bzktq\" (UID: \"f7be25ae-21fc-427e-b814-c59bcf4f6502\") " pod="kuadrant-system/authorino-58cd955675-bzktq" Jul 07 01:09:23.753636 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:23.753612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4g9q\" (UniqueName: \"kubernetes.io/projected/f7be25ae-21fc-427e-b814-c59bcf4f6502-kube-api-access-q4g9q\") pod \"authorino-58cd955675-bzktq\" (UID: \"f7be25ae-21fc-427e-b814-c59bcf4f6502\") " pod="kuadrant-system/authorino-58cd955675-bzktq" Jul 07 01:09:23.851483 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:23.851406 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bzktq" Jul 07 01:09:23.962440 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:23.962403 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" event={"ID":"e1c1e4ff-8053-47da-bca6-d60e91ed16d4","Type":"ContainerStarted","Data":"a7ae09ed0bdd90f9ce1ceca6ff7d45da6977c969d3d480bc90d1139e87c17873"} Jul 07 01:09:23.986890 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:23.982327 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bzktq"] Jul 07 01:09:23.988476 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:09:23.988445 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7be25ae_21fc_427e_b814_c59bcf4f6502.slice/crio-a88d3797c782628f295ed90c7dd3255e511ac0a88472eaf3cda263f5fe1431ac WatchSource:0}: Error finding container a88d3797c782628f295ed90c7dd3255e511ac0a88472eaf3cda263f5fe1431ac: Status 404 returned error can't find the container with id a88d3797c782628f295ed90c7dd3255e511ac0a88472eaf3cda263f5fe1431ac Jul 07 01:09:24.972983 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:24.972947 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bzktq" event={"ID":"f7be25ae-21fc-427e-b814-c59bcf4f6502","Type":"ContainerStarted","Data":"a88d3797c782628f295ed90c7dd3255e511ac0a88472eaf3cda263f5fe1431ac"} Jul 07 01:09:27.991754 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:27.991714 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" event={"ID":"e1c1e4ff-8053-47da-bca6-d60e91ed16d4","Type":"ContainerStarted","Data":"83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43"} Jul 07 01:09:27.992169 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:27.991904 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" Jul 07 01:09:27.998595 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:27.998571 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bzktq" event={"ID":"f7be25ae-21fc-427e-b814-c59bcf4f6502","Type":"ContainerStarted","Data":"da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a"} Jul 07 01:09:28.011189 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:28.011140 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" podStartSLOduration=1.403796832 podStartE2EDuration="6.011124677s" totalImagesPullingTime="4.607327845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:09:28.009356285 +0000 UTC m=+494.015763098" watchObservedRunningTime="2026-07-07 01:09:28.011124677 +0000 UTC m=+494.017531457" Jul 07 01:09:28.025336 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:28.025277 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-bzktq" podStartSLOduration=1.137023732 podStartE2EDuration="5.025238273s" totalImagesPullingTime="3.888214541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:09:28.022914512 +0000 UTC m=+494.029321291" watchObservedRunningTime="2026-07-07 01:09:28.025238273 +0000 UTC m=+494.031645055" Jul 07 01:09:28.423168 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:28.423138 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bzktq"] Jul 07 01:09:30.007160 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:30.007123 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-bzktq" podUID="f7be25ae-21fc-427e-b814-c59bcf4f6502" containerName="authorino" containerID="cri-o://da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a" gracePeriod=30 Jul 07 01:09:30.254333 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:30.254308 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bzktq" Jul 07 01:09:30.316216 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:30.316139 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4g9q\" (UniqueName: \"kubernetes.io/projected/f7be25ae-21fc-427e-b814-c59bcf4f6502-kube-api-access-q4g9q\") pod \"f7be25ae-21fc-427e-b814-c59bcf4f6502\" (UID: \"f7be25ae-21fc-427e-b814-c59bcf4f6502\") " Jul 07 01:09:30.318369 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:30.318347 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7be25ae-21fc-427e-b814-c59bcf4f6502-kube-api-access-q4g9q" (OuterVolumeSpecName: "kube-api-access-q4g9q") pod "f7be25ae-21fc-427e-b814-c59bcf4f6502" (UID: "f7be25ae-21fc-427e-b814-c59bcf4f6502"). InnerVolumeSpecName "kube-api-access-q4g9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:09:30.416921 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:30.416880 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4g9q\" (UniqueName: \"kubernetes.io/projected/f7be25ae-21fc-427e-b814-c59bcf4f6502-kube-api-access-q4g9q\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:09:31.012971 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:31.012932 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7be25ae-21fc-427e-b814-c59bcf4f6502" containerID="da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a" exitCode=0 Jul 07 01:09:31.013458 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:31.012997 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bzktq" Jul 07 01:09:31.013458 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:31.013017 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bzktq" event={"ID":"f7be25ae-21fc-427e-b814-c59bcf4f6502","Type":"ContainerDied","Data":"da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a"} Jul 07 01:09:31.013458 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:31.013079 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bzktq" event={"ID":"f7be25ae-21fc-427e-b814-c59bcf4f6502","Type":"ContainerDied","Data":"a88d3797c782628f295ed90c7dd3255e511ac0a88472eaf3cda263f5fe1431ac"} Jul 07 01:09:31.013458 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:31.013120 2576 scope.go:117] "RemoveContainer" containerID="da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a" Jul 07 01:09:31.021544 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:31.021527 2576 scope.go:117] "RemoveContainer" containerID="da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a" Jul 07 01:09:31.021800 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:09:31.021781 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a\": container with ID starting with da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a not found: ID does not exist" containerID="da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a" Jul 07 01:09:31.021852 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:31.021810 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a"} err="failed to get container status \"da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a\": rpc error: code = NotFound desc = could not find container \"da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a\": container with ID starting with da8d33188b2bc8f82ae9688ccdf9961b7c0a8fd91b9ab6e20b7e91a84f86647a not found: ID does not exist" Jul 07 01:09:31.030013 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:31.029987 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bzktq"] Jul 07 01:09:31.033043 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:31.033023 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-bzktq"] Jul 07 01:09:32.548933 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:32.548900 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7be25ae-21fc-427e-b814-c59bcf4f6502" path="/var/lib/kubelet/pods/f7be25ae-21fc-427e-b814-c59bcf4f6502/volumes" Jul 07 01:09:39.003655 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:39.003628 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" Jul 07 01:09:39.426586 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:39.426545 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h4hbb"] Jul 07 01:09:39.426798 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:39.426773 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" podUID="e1c1e4ff-8053-47da-bca6-d60e91ed16d4" containerName="limitador" containerID="cri-o://83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43" gracePeriod=30 Jul 07 01:09:39.977194 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:39.977172 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" Jul 07 01:09:40.055189 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.055111 2576 generic.go:356] "Generic (PLEG): container finished" podID="e1c1e4ff-8053-47da-bca6-d60e91ed16d4" containerID="83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43" exitCode=0 Jul 07 01:09:40.055189 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.055155 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" Jul 07 01:09:40.055626 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.055202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" event={"ID":"e1c1e4ff-8053-47da-bca6-d60e91ed16d4","Type":"ContainerDied","Data":"83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43"} Jul 07 01:09:40.055626 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.055247 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-h4hbb" event={"ID":"e1c1e4ff-8053-47da-bca6-d60e91ed16d4","Type":"ContainerDied","Data":"a7ae09ed0bdd90f9ce1ceca6ff7d45da6977c969d3d480bc90d1139e87c17873"} Jul 07 01:09:40.055626 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.055286 2576 scope.go:117] "RemoveContainer" containerID="83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43" Jul 07 01:09:40.063283 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.063244 2576 scope.go:117] "RemoveContainer" containerID="83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43" Jul 07 01:09:40.063577 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:09:40.063560 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43\": container with ID starting with 83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43 not found: ID does not exist" containerID="83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43" Jul 07 01:09:40.063630 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.063586 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43"} err="failed to get container status \"83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43\": rpc error: code = NotFound desc = could not find container \"83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43\": container with ID starting with 83dda6a8f284572bbe87c869f8cfa5b8e6c61a7b9fb0c861097829c76a7efa43 not found: ID does not exist" Jul 07 01:09:40.099887 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.099864 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2pgj\" (UniqueName: \"kubernetes.io/projected/e1c1e4ff-8053-47da-bca6-d60e91ed16d4-kube-api-access-k2pgj\") pod \"e1c1e4ff-8053-47da-bca6-d60e91ed16d4\" (UID: \"e1c1e4ff-8053-47da-bca6-d60e91ed16d4\") " Jul 07 01:09:40.099992 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.099930 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1c1e4ff-8053-47da-bca6-d60e91ed16d4-config-file\") pod \"e1c1e4ff-8053-47da-bca6-d60e91ed16d4\" (UID: \"e1c1e4ff-8053-47da-bca6-d60e91ed16d4\") " Jul 07 01:09:40.100241 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.100221 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1c1e4ff-8053-47da-bca6-d60e91ed16d4-config-file" (OuterVolumeSpecName: "config-file") pod "e1c1e4ff-8053-47da-bca6-d60e91ed16d4" (UID: "e1c1e4ff-8053-47da-bca6-d60e91ed16d4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:09:40.101957 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.101932 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1c1e4ff-8053-47da-bca6-d60e91ed16d4-kube-api-access-k2pgj" (OuterVolumeSpecName: "kube-api-access-k2pgj") pod "e1c1e4ff-8053-47da-bca6-d60e91ed16d4" (UID: "e1c1e4ff-8053-47da-bca6-d60e91ed16d4"). InnerVolumeSpecName "kube-api-access-k2pgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:09:40.201390 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.201361 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2pgj\" (UniqueName: \"kubernetes.io/projected/e1c1e4ff-8053-47da-bca6-d60e91ed16d4-kube-api-access-k2pgj\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:09:40.201390 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.201385 2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1c1e4ff-8053-47da-bca6-d60e91ed16d4-config-file\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:09:40.376700 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.376669 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h4hbb"] Jul 07 01:09:40.379055 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.379027 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-h4hbb"] Jul 07 01:09:40.548479 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:40.548448 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1c1e4ff-8053-47da-bca6-d60e91ed16d4" path="/var/lib/kubelet/pods/e1c1e4ff-8053-47da-bca6-d60e91ed16d4/volumes" Jul 07 01:09:45.434031 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.433997 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-4fqkc"] Jul 07 01:09:45.434540 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.434395 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1c1e4ff-8053-47da-bca6-d60e91ed16d4" containerName="limitador" Jul 07 01:09:45.434540 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.434408 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1c1e4ff-8053-47da-bca6-d60e91ed16d4" containerName="limitador" Jul 07 01:09:45.434540 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.434430 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7be25ae-21fc-427e-b814-c59bcf4f6502" containerName="authorino" Jul 07 01:09:45.434540 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.434435 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7be25ae-21fc-427e-b814-c59bcf4f6502" containerName="authorino" Jul 07 01:09:45.434540 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.434485 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7be25ae-21fc-427e-b814-c59bcf4f6502" containerName="authorino" Jul 07 01:09:45.434540 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.434494 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1c1e4ff-8053-47da-bca6-d60e91ed16d4" containerName="limitador" Jul 07 01:09:45.439386 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.439359 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-4fqkc" Jul 07 01:09:45.442474 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.442451 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tl64b\"" Jul 07 01:09:45.442604 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.442458 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 01:09:45.447068 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.447042 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-4fqkc"] Jul 07 01:09:45.555698 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.555657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtvmq\" (UniqueName: \"kubernetes.io/projected/dd68a3f6-5dff-486f-a424-9ff84b251d5b-kube-api-access-jtvmq\") pod \"postgres-69fb4594cf-4fqkc\" (UID: \"dd68a3f6-5dff-486f-a424-9ff84b251d5b\") " pod="opendatahub/postgres-69fb4594cf-4fqkc" Jul 07 01:09:45.555698 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.555694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dd68a3f6-5dff-486f-a424-9ff84b251d5b-data\") pod \"postgres-69fb4594cf-4fqkc\" (UID: \"dd68a3f6-5dff-486f-a424-9ff84b251d5b\") " pod="opendatahub/postgres-69fb4594cf-4fqkc" Jul 07 01:09:45.657157 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.656952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtvmq\" (UniqueName: \"kubernetes.io/projected/dd68a3f6-5dff-486f-a424-9ff84b251d5b-kube-api-access-jtvmq\") pod \"postgres-69fb4594cf-4fqkc\" (UID: \"dd68a3f6-5dff-486f-a424-9ff84b251d5b\") " pod="opendatahub/postgres-69fb4594cf-4fqkc" Jul 07 01:09:45.657157 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.657028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dd68a3f6-5dff-486f-a424-9ff84b251d5b-data\") pod \"postgres-69fb4594cf-4fqkc\" (UID: \"dd68a3f6-5dff-486f-a424-9ff84b251d5b\") " pod="opendatahub/postgres-69fb4594cf-4fqkc" Jul 07 01:09:45.657487 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.657470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dd68a3f6-5dff-486f-a424-9ff84b251d5b-data\") pod \"postgres-69fb4594cf-4fqkc\" (UID: \"dd68a3f6-5dff-486f-a424-9ff84b251d5b\") " pod="opendatahub/postgres-69fb4594cf-4fqkc" Jul 07 01:09:45.666183 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.666161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtvmq\" (UniqueName: \"kubernetes.io/projected/dd68a3f6-5dff-486f-a424-9ff84b251d5b-kube-api-access-jtvmq\") pod \"postgres-69fb4594cf-4fqkc\" (UID: \"dd68a3f6-5dff-486f-a424-9ff84b251d5b\") " pod="opendatahub/postgres-69fb4594cf-4fqkc" Jul 07 01:09:45.751961 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.751862 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-4fqkc" Jul 07 01:09:45.887874 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:45.887851 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-4fqkc"] Jul 07 01:09:45.889827 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:09:45.889797 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd68a3f6_5dff_486f_a424_9ff84b251d5b.slice/crio-4f086b7a7fd91aa2d6158952feaea85673a2d7479bb08940f66d1de0790de341 WatchSource:0}: Error finding container 4f086b7a7fd91aa2d6158952feaea85673a2d7479bb08940f66d1de0790de341: Status 404 returned error can't find the container with id 4f086b7a7fd91aa2d6158952feaea85673a2d7479bb08940f66d1de0790de341 Jul 07 01:09:46.084027 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:46.083934 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-4fqkc" event={"ID":"dd68a3f6-5dff-486f-a424-9ff84b251d5b","Type":"ContainerStarted","Data":"4f086b7a7fd91aa2d6158952feaea85673a2d7479bb08940f66d1de0790de341"} Jul 07 01:09:51.112238 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:51.112195 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-4fqkc" event={"ID":"dd68a3f6-5dff-486f-a424-9ff84b251d5b","Type":"ContainerStarted","Data":"55435cce70a803dfb0afc5c9cb9b7cd2c7267902d852e13e476e80e25bdce9a7"} Jul 07 01:09:51.112699 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:51.112255 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-4fqkc" Jul 07 01:09:51.145662 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:51.145612 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-4fqkc" podStartSLOduration=1.461542633 podStartE2EDuration="6.145598288s" totalImagesPullingTime="4.684055655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:09:51.144766323 +0000 UTC m=+517.151173125" watchObservedRunningTime="2026-07-07 01:09:51.145598288 +0000 UTC m=+517.152005084" Jul 07 01:09:57.147310 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.147281 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-4fqkc" Jul 07 01:09:57.677610 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.677580 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28bf7"] Jul 07 01:09:57.681241 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.681221 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28bf7" Jul 07 01:09:57.684120 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.684102 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 01:09:57.684252 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.684188 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-97xpr\"" Jul 07 01:09:57.684252 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.684199 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 01:09:57.687742 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.687720 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28bf7"] Jul 07 01:09:57.765384 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.765352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r25jx\" (UniqueName: \"kubernetes.io/projected/a8f68403-f083-4712-94da-aa7726886804-kube-api-access-r25jx\") pod \"authorino-5d4b67c446-28bf7\" (UID: \"a8f68403-f083-4712-94da-aa7726886804\") " pod="kuadrant-system/authorino-5d4b67c446-28bf7" Jul 07 01:09:57.866943 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.866905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r25jx\" (UniqueName: \"kubernetes.io/projected/a8f68403-f083-4712-94da-aa7726886804-kube-api-access-r25jx\") pod \"authorino-5d4b67c446-28bf7\" (UID: \"a8f68403-f083-4712-94da-aa7726886804\") " pod="kuadrant-system/authorino-5d4b67c446-28bf7" Jul 07 01:09:57.876435 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.876406 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r25jx\" (UniqueName: \"kubernetes.io/projected/a8f68403-f083-4712-94da-aa7726886804-kube-api-access-r25jx\") pod \"authorino-5d4b67c446-28bf7\" (UID: \"a8f68403-f083-4712-94da-aa7726886804\") " pod="kuadrant-system/authorino-5d4b67c446-28bf7" Jul 07 01:09:57.920660 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.920631 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28bf7"] Jul 07 01:09:57.920899 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.920886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28bf7" Jul 07 01:09:57.942866 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.942836 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-595bd9988f-fnznh"] Jul 07 01:09:57.947696 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.947678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-595bd9988f-fnznh" Jul 07 01:09:57.951156 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.951130 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-595bd9988f-fnznh"] Jul 07 01:09:57.968181 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:57.968157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmq6h\" (UniqueName: \"kubernetes.io/projected/62982204-89ea-413a-afd2-1860e8a5457f-kube-api-access-jmq6h\") pod \"authorino-595bd9988f-fnznh\" (UID: \"62982204-89ea-413a-afd2-1860e8a5457f\") " pod="kuadrant-system/authorino-595bd9988f-fnznh" Jul 07 01:09:58.050188 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:58.050166 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28bf7"] Jul 07 01:09:58.052112 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:09:58.052079 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8f68403_f083_4712_94da_aa7726886804.slice/crio-821149b1baa974e07a7492edb6cb617922558a6b20d9ccc90af8e615488729c1 WatchSource:0}: Error finding container 821149b1baa974e07a7492edb6cb617922558a6b20d9ccc90af8e615488729c1: Status 404 returned error can't find the container with id 821149b1baa974e07a7492edb6cb617922558a6b20d9ccc90af8e615488729c1 Jul 07 01:09:58.069616 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:58.069591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmq6h\" (UniqueName: \"kubernetes.io/projected/62982204-89ea-413a-afd2-1860e8a5457f-kube-api-access-jmq6h\") pod \"authorino-595bd9988f-fnznh\" (UID: \"62982204-89ea-413a-afd2-1860e8a5457f\") " pod="kuadrant-system/authorino-595bd9988f-fnznh" Jul 07 01:09:58.077530 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:58.077508 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmq6h\" (UniqueName: \"kubernetes.io/projected/62982204-89ea-413a-afd2-1860e8a5457f-kube-api-access-jmq6h\") pod \"authorino-595bd9988f-fnznh\" (UID: \"62982204-89ea-413a-afd2-1860e8a5457f\") " pod="kuadrant-system/authorino-595bd9988f-fnznh" Jul 07 01:09:58.152930 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:58.152888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28bf7" event={"ID":"a8f68403-f083-4712-94da-aa7726886804","Type":"ContainerStarted","Data":"821149b1baa974e07a7492edb6cb617922558a6b20d9ccc90af8e615488729c1"} Jul 07 01:09:58.257573 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:58.257483 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-595bd9988f-fnznh" Jul 07 01:09:58.381451 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:58.381427 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-595bd9988f-fnznh"] Jul 07 01:09:58.383119 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:09:58.383098 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62982204_89ea_413a_afd2_1860e8a5457f.slice/crio-5fc204580af1c9e0329c59532baf263d90acdee50de1113b0b021ed4c725a0a1 WatchSource:0}: Error finding container 5fc204580af1c9e0329c59532baf263d90acdee50de1113b0b021ed4c725a0a1: Status 404 returned error can't find the container with id 5fc204580af1c9e0329c59532baf263d90acdee50de1113b0b021ed4c725a0a1 Jul 07 01:09:59.159104 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:59.159071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28bf7" event={"ID":"a8f68403-f083-4712-94da-aa7726886804","Type":"ContainerStarted","Data":"5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962"} Jul 07 01:09:59.159104 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:59.159088 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-28bf7" podUID="a8f68403-f083-4712-94da-aa7726886804" containerName="authorino" containerID="cri-o://5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962" gracePeriod=30 Jul 07 01:09:59.160552 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:59.160528 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-595bd9988f-fnznh" event={"ID":"62982204-89ea-413a-afd2-1860e8a5457f","Type":"ContainerStarted","Data":"e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce"} Jul 07 01:09:59.160552 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:59.160561 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-595bd9988f-fnznh" event={"ID":"62982204-89ea-413a-afd2-1860e8a5457f","Type":"ContainerStarted","Data":"5fc204580af1c9e0329c59532baf263d90acdee50de1113b0b021ed4c725a0a1"} Jul 07 01:09:59.174036 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:59.173997 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-28bf7" podStartSLOduration=1.845226263 podStartE2EDuration="2.17398274s" totalImagesPullingTime="328.756477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:09:59.173353185 +0000 UTC m=+525.179759977" watchObservedRunningTime="2026-07-07 01:09:59.17398274 +0000 UTC m=+525.180389522" Jul 07 01:09:59.187300 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:59.187159 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-595bd9988f-fnznh" podStartSLOduration=1.8553966910000002 podStartE2EDuration="2.187142011s" totalImagesPullingTime="331.74532ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:09:59.186937441 +0000 UTC m=+525.193344243" watchObservedRunningTime="2026-07-07 01:09:59.187142011 +0000 UTC m=+525.193548793" Jul 07 01:09:59.403845 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:59.403819 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28bf7" Jul 07 01:09:59.482486 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:59.482416 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r25jx\" (UniqueName: \"kubernetes.io/projected/a8f68403-f083-4712-94da-aa7726886804-kube-api-access-r25jx\") pod \"a8f68403-f083-4712-94da-aa7726886804\" (UID: \"a8f68403-f083-4712-94da-aa7726886804\") " Jul 07 01:09:59.484502 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:59.484476 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8f68403-f083-4712-94da-aa7726886804-kube-api-access-r25jx" (OuterVolumeSpecName: "kube-api-access-r25jx") pod "a8f68403-f083-4712-94da-aa7726886804" (UID: "a8f68403-f083-4712-94da-aa7726886804"). InnerVolumeSpecName "kube-api-access-r25jx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:09:59.583438 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:09:59.583404 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r25jx\" (UniqueName: \"kubernetes.io/projected/a8f68403-f083-4712-94da-aa7726886804-kube-api-access-r25jx\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:10:00.167908 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:00.167872 2576 generic.go:356] "Generic (PLEG): container finished" podID="a8f68403-f083-4712-94da-aa7726886804" containerID="5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962" exitCode=0 Jul 07 01:10:00.167908 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:00.167911 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28bf7" Jul 07 01:10:00.168440 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:00.167964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28bf7" event={"ID":"a8f68403-f083-4712-94da-aa7726886804","Type":"ContainerDied","Data":"5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962"} Jul 07 01:10:00.168440 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:00.168006 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28bf7" event={"ID":"a8f68403-f083-4712-94da-aa7726886804","Type":"ContainerDied","Data":"821149b1baa974e07a7492edb6cb617922558a6b20d9ccc90af8e615488729c1"} Jul 07 01:10:00.168440 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:00.168027 2576 scope.go:117] "RemoveContainer" containerID="5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962" Jul 07 01:10:00.176912 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:00.176897 2576 scope.go:117] "RemoveContainer" containerID="5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962" Jul 07 01:10:00.177165 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:00.177148 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962\": container with ID starting with 5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962 not found: ID does not exist" containerID="5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962" Jul 07 01:10:00.177207 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:00.177174 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962"} err="failed to get container status \"5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962\": rpc error: code = NotFound desc = could not find container \"5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962\": container with ID starting with 5245d4ed40e4aa89f8b2aded35ed1de54906ea27cfbd67c58cee2aa63e18e962 not found: ID does not exist" Jul 07 01:10:00.207216 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:00.207188 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28bf7"] Jul 07 01:10:00.216911 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:00.216894 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28bf7"] Jul 07 01:10:00.548403 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:00.548331 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8f68403-f083-4712-94da-aa7726886804" path="/var/lib/kubelet/pods/a8f68403-f083-4712-94da-aa7726886804/volumes" Jul 07 01:10:03.378173 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.378132 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dd47dcc8-5trbh"] Jul 07 01:10:03.378771 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.378689 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8f68403-f083-4712-94da-aa7726886804" containerName="authorino" Jul 07 01:10:03.378771 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.378710 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8f68403-f083-4712-94da-aa7726886804" containerName="authorino" Jul 07 01:10:03.378886 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.378822 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8f68403-f083-4712-94da-aa7726886804" containerName="authorino" Jul 07 01:10:03.383222 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.383200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:03.386917 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.386895 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 01:10:03.387051 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.386919 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 01:10:03.387051 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.386941 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mb89m\"" Jul 07 01:10:03.392943 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.392914 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd47dcc8-5trbh"] Jul 07 01:10:03.422690 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.422657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert\") pod \"maas-controller-dd47dcc8-5trbh\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:03.422690 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.422699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsvzl\" (UniqueName: \"kubernetes.io/projected/87737711-5fbf-4a19-99f1-430d05a3e863-kube-api-access-lsvzl\") pod \"maas-controller-dd47dcc8-5trbh\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:03.523806 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.523761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert\") pod \"maas-controller-dd47dcc8-5trbh\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:03.524012 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.523813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsvzl\" (UniqueName: \"kubernetes.io/projected/87737711-5fbf-4a19-99f1-430d05a3e863-kube-api-access-lsvzl\") pod \"maas-controller-dd47dcc8-5trbh\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:03.524012 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:03.523950 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 01:10:03.524131 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:03.524028 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert podName:87737711-5fbf-4a19-99f1-430d05a3e863 nodeName:}" failed. No retries permitted until 2026-07-07 01:10:04.024007305 +0000 UTC m=+530.030414064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert") pod "maas-controller-dd47dcc8-5trbh" (UID: "87737711-5fbf-4a19-99f1-430d05a3e863") : secret "maas-controller-webhook-cert" not found Jul 07 01:10:03.534994 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.534970 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsvzl\" (UniqueName: \"kubernetes.io/projected/87737711-5fbf-4a19-99f1-430d05a3e863-kube-api-access-lsvzl\") pod \"maas-controller-dd47dcc8-5trbh\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:03.549523 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.549490 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dccc95f8-v99b6"] Jul 07 01:10:03.553162 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.553142 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:03.564512 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.564478 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dccc95f8-v99b6"] Jul 07 01:10:03.625301 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.625233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z58cj\" (UniqueName: \"kubernetes.io/projected/0e694b4b-64f5-4765-ba76-97b23af8cda2-kube-api-access-z58cj\") pod \"maas-controller-75dccc95f8-v99b6\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:03.625476 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.625454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert\") pod \"maas-controller-75dccc95f8-v99b6\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:03.726499 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.726409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z58cj\" (UniqueName: \"kubernetes.io/projected/0e694b4b-64f5-4765-ba76-97b23af8cda2-kube-api-access-z58cj\") pod \"maas-controller-75dccc95f8-v99b6\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:03.726661 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.726564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert\") pod \"maas-controller-75dccc95f8-v99b6\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:03.726723 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:03.726703 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 01:10:03.726776 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:03.726767 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert podName:0e694b4b-64f5-4765-ba76-97b23af8cda2 nodeName:}" failed. No retries permitted until 2026-07-07 01:10:04.226751814 +0000 UTC m=+530.233158578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert") pod "maas-controller-75dccc95f8-v99b6" (UID: "0e694b4b-64f5-4765-ba76-97b23af8cda2") : secret "maas-controller-webhook-cert" not found Jul 07 01:10:03.735230 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:03.735203 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z58cj\" (UniqueName: \"kubernetes.io/projected/0e694b4b-64f5-4765-ba76-97b23af8cda2-kube-api-access-z58cj\") pod \"maas-controller-75dccc95f8-v99b6\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:04.029513 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:04.029423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert\") pod \"maas-controller-dd47dcc8-5trbh\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:04.029513 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:04.029469 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 01:10:04.029690 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:04.029530 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert podName:87737711-5fbf-4a19-99f1-430d05a3e863 nodeName:}" failed. No retries permitted until 2026-07-07 01:10:05.029517223 +0000 UTC m=+531.035923982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert") pod "maas-controller-dd47dcc8-5trbh" (UID: "87737711-5fbf-4a19-99f1-430d05a3e863") : secret "maas-controller-webhook-cert" not found Jul 07 01:10:04.230721 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:04.230684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert\") pod \"maas-controller-75dccc95f8-v99b6\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:04.230913 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:04.230832 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 01:10:04.230913 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:04.230893 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert podName:0e694b4b-64f5-4765-ba76-97b23af8cda2 nodeName:}" failed. No retries permitted until 2026-07-07 01:10:05.230878125 +0000 UTC m=+531.237284885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert") pod "maas-controller-75dccc95f8-v99b6" (UID: "0e694b4b-64f5-4765-ba76-97b23af8cda2") : secret "maas-controller-webhook-cert" not found Jul 07 01:10:05.039867 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:05.039828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert\") pod \"maas-controller-dd47dcc8-5trbh\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:05.040318 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:05.039974 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 01:10:05.040318 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:05.040034 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert podName:87737711-5fbf-4a19-99f1-430d05a3e863 nodeName:}" failed. No retries permitted until 2026-07-07 01:10:07.040020782 +0000 UTC m=+533.046427541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert") pod "maas-controller-dd47dcc8-5trbh" (UID: "87737711-5fbf-4a19-99f1-430d05a3e863") : secret "maas-controller-webhook-cert" not found Jul 07 01:10:05.242132 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:05.242094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert\") pod \"maas-controller-75dccc95f8-v99b6\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:05.242330 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:05.242245 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 01:10:05.242330 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:05.242328 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert podName:0e694b4b-64f5-4765-ba76-97b23af8cda2 nodeName:}" failed. No retries permitted until 2026-07-07 01:10:07.242313243 +0000 UTC m=+533.248720003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert") pod "maas-controller-75dccc95f8-v99b6" (UID: "0e694b4b-64f5-4765-ba76-97b23af8cda2") : secret "maas-controller-webhook-cert" not found Jul 07 01:10:07.058017 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:07.057937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert\") pod \"maas-controller-dd47dcc8-5trbh\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:07.058378 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:07.058075 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 01:10:07.058378 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:07.058132 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert podName:87737711-5fbf-4a19-99f1-430d05a3e863 nodeName:}" failed. No retries permitted until 2026-07-07 01:10:11.058118236 +0000 UTC m=+537.064524996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert") pod "maas-controller-dd47dcc8-5trbh" (UID: "87737711-5fbf-4a19-99f1-430d05a3e863") : secret "maas-controller-webhook-cert" not found Jul 07 01:10:07.260413 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:07.260377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert\") pod \"maas-controller-75dccc95f8-v99b6\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:07.260591 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:07.260494 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 01:10:07.260591 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:07.260546 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert podName:0e694b4b-64f5-4765-ba76-97b23af8cda2 nodeName:}" failed. No retries permitted until 2026-07-07 01:10:11.260532599 +0000 UTC m=+537.266939359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert") pod "maas-controller-75dccc95f8-v99b6" (UID: "0e694b4b-64f5-4765-ba76-97b23af8cda2") : secret "maas-controller-webhook-cert" not found Jul 07 01:10:11.099075 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:11.099036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert\") pod \"maas-controller-dd47dcc8-5trbh\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:11.099501 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:11.099209 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 01:10:11.099501 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:11.099304 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert podName:87737711-5fbf-4a19-99f1-430d05a3e863 nodeName:}" failed. No retries permitted until 2026-07-07 01:10:19.099287862 +0000 UTC m=+545.105694621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert") pod "maas-controller-dd47dcc8-5trbh" (UID: "87737711-5fbf-4a19-99f1-430d05a3e863") : secret "maas-controller-webhook-cert" not found Jul 07 01:10:11.300729 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:11.300690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert\") pod \"maas-controller-75dccc95f8-v99b6\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:11.300896 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:11.300814 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 07 01:10:11.300896 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:11.300864 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert podName:0e694b4b-64f5-4765-ba76-97b23af8cda2 nodeName:}" failed. No retries permitted until 2026-07-07 01:10:19.300852463 +0000 UTC m=+545.307259223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert") pod "maas-controller-75dccc95f8-v99b6" (UID: "0e694b4b-64f5-4765-ba76-97b23af8cda2") : secret "maas-controller-webhook-cert" not found Jul 07 01:10:19.176651 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:19.176615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert\") pod \"maas-controller-dd47dcc8-5trbh\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:19.179202 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:19.179178 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert\") pod \"maas-controller-dd47dcc8-5trbh\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:19.298161 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:19.298128 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mb89m\"" Jul 07 01:10:19.305534 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:19.305507 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:19.378790 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:19.378705 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert\") pod \"maas-controller-75dccc95f8-v99b6\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:19.381276 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:19.381241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert\") pod \"maas-controller-75dccc95f8-v99b6\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:19.447626 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:19.447553 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd47dcc8-5trbh"] Jul 07 01:10:19.450789 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:10:19.450761 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87737711_5fbf_4a19_99f1_430d05a3e863.slice/crio-a2c426992e7e737409ab2024ed218c136dd5a2a57ebcabdfe76b78662f850a4d WatchSource:0}: Error finding container a2c426992e7e737409ab2024ed218c136dd5a2a57ebcabdfe76b78662f850a4d: Status 404 returned error can't find the container with id a2c426992e7e737409ab2024ed218c136dd5a2a57ebcabdfe76b78662f850a4d Jul 07 01:10:19.471570 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:19.471548 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:19.610377 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:19.610357 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dccc95f8-v99b6"] Jul 07 01:10:19.612198 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:10:19.612166 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e694b4b_64f5_4765_ba76_97b23af8cda2.slice/crio-be8d9b4c0d86998bdba13f7fff7452c00d70197751da89a4fa1499f3758745f6 WatchSource:0}: Error finding container be8d9b4c0d86998bdba13f7fff7452c00d70197751da89a4fa1499f3758745f6: Status 404 returned error can't find the container with id be8d9b4c0d86998bdba13f7fff7452c00d70197751da89a4fa1499f3758745f6 Jul 07 01:10:20.266689 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:20.266644 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dccc95f8-v99b6" event={"ID":"0e694b4b-64f5-4765-ba76-97b23af8cda2","Type":"ContainerStarted","Data":"be8d9b4c0d86998bdba13f7fff7452c00d70197751da89a4fa1499f3758745f6"} Jul 07 01:10:20.268238 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:20.268211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd47dcc8-5trbh" event={"ID":"87737711-5fbf-4a19-99f1-430d05a3e863","Type":"ContainerStarted","Data":"a2c426992e7e737409ab2024ed218c136dd5a2a57ebcabdfe76b78662f850a4d"} Jul 07 01:10:21.858296 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:21.858257 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 01:10:22.279030 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:22.278998 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dccc95f8-v99b6" event={"ID":"0e694b4b-64f5-4765-ba76-97b23af8cda2","Type":"ContainerStarted","Data":"247ae1050e06d924c9ca28f226301da7435855665f68eb3a0501a0a80a168e1d"} Jul 07 01:10:22.279227 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:22.279060 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:22.280647 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:22.280623 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd47dcc8-5trbh" event={"ID":"87737711-5fbf-4a19-99f1-430d05a3e863","Type":"ContainerStarted","Data":"0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7"} Jul 07 01:10:22.280761 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:22.280677 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:22.297544 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:22.297494 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dccc95f8-v99b6" podStartSLOduration=17.048930852 podStartE2EDuration="19.297478568s" totalImagesPullingTime="2.248547716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:10:22.296439591 +0000 UTC m=+548.302846365" watchObservedRunningTime="2026-07-07 01:10:22.297478568 +0000 UTC m=+548.303885350" Jul 07 01:10:22.315115 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:22.315066 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dd47dcc8-5trbh" podStartSLOduration=16.912016388 podStartE2EDuration="19.315049373s" totalImagesPullingTime="2.403032985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:10:22.314330301 +0000 UTC m=+548.320737084" watchObservedRunningTime="2026-07-07 01:10:22.315049373 +0000 UTC m=+548.321456156" Jul 07 01:10:33.297368 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:33.297336 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:10:33.297772 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:33.297421 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:33.354984 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:33.354952 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dd47dcc8-5trbh"] Jul 07 01:10:33.355234 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:33.355209 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-dd47dcc8-5trbh" podUID="87737711-5fbf-4a19-99f1-430d05a3e863" containerName="manager" containerID="cri-o://0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7" gracePeriod=30 Jul 07 01:10:33.603903 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:33.603880 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:33.714141 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:33.714098 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert\") pod \"87737711-5fbf-4a19-99f1-430d05a3e863\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " Jul 07 01:10:33.714141 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:33.714141 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsvzl\" (UniqueName: \"kubernetes.io/projected/87737711-5fbf-4a19-99f1-430d05a3e863-kube-api-access-lsvzl\") pod \"87737711-5fbf-4a19-99f1-430d05a3e863\" (UID: \"87737711-5fbf-4a19-99f1-430d05a3e863\") " Jul 07 01:10:33.716516 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:33.716481 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "87737711-5fbf-4a19-99f1-430d05a3e863" (UID: "87737711-5fbf-4a19-99f1-430d05a3e863"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:10:33.716624 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:33.716516 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87737711-5fbf-4a19-99f1-430d05a3e863-kube-api-access-lsvzl" (OuterVolumeSpecName: "kube-api-access-lsvzl") pod "87737711-5fbf-4a19-99f1-430d05a3e863" (UID: "87737711-5fbf-4a19-99f1-430d05a3e863"). InnerVolumeSpecName "kube-api-access-lsvzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:10:33.815066 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:33.815028 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87737711-5fbf-4a19-99f1-430d05a3e863-webhook-cert\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:10:33.815066 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:33.815064 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsvzl\" (UniqueName: \"kubernetes.io/projected/87737711-5fbf-4a19-99f1-430d05a3e863-kube-api-access-lsvzl\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:10:34.344247 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:34.344212 2576 generic.go:356] "Generic (PLEG): container finished" podID="87737711-5fbf-4a19-99f1-430d05a3e863" containerID="0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7" exitCode=0 Jul 07 01:10:34.344658 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:34.344273 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd47dcc8-5trbh" Jul 07 01:10:34.344658 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:34.344306 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd47dcc8-5trbh" event={"ID":"87737711-5fbf-4a19-99f1-430d05a3e863","Type":"ContainerDied","Data":"0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7"} Jul 07 01:10:34.344658 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:34.344367 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd47dcc8-5trbh" event={"ID":"87737711-5fbf-4a19-99f1-430d05a3e863","Type":"ContainerDied","Data":"a2c426992e7e737409ab2024ed218c136dd5a2a57ebcabdfe76b78662f850a4d"} Jul 07 01:10:34.344658 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:34.344396 2576 scope.go:117] "RemoveContainer" containerID="0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7" Jul 07 01:10:34.353452 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:34.353436 2576 scope.go:117] "RemoveContainer" containerID="0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7" Jul 07 01:10:34.353685 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:10:34.353668 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7\": container with ID starting with 0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7 not found: ID does not exist" containerID="0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7" Jul 07 01:10:34.353728 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:34.353693 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7"} err="failed to get container status \"0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7\": rpc error: code = NotFound desc = could not find container \"0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7\": container with ID starting with 0ad0f8b723cb1bb6b64e44e2eefefc7a451065dbf8a4889fb36adf511e6b8ed7 not found: ID does not exist" Jul 07 01:10:34.364750 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:34.364601 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dd47dcc8-5trbh"] Jul 07 01:10:34.366817 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:34.366792 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dd47dcc8-5trbh"] Jul 07 01:10:34.549091 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:34.549058 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87737711-5fbf-4a19-99f1-430d05a3e863" path="/var/lib/kubelet/pods/87737711-5fbf-4a19-99f1-430d05a3e863/volumes" Jul 07 01:10:54.039044 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.039008 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-cc8d47df9-zd6rt"] Jul 07 01:10:54.039478 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.039389 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87737711-5fbf-4a19-99f1-430d05a3e863" containerName="manager" Jul 07 01:10:54.039478 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.039401 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87737711-5fbf-4a19-99f1-430d05a3e863" containerName="manager" Jul 07 01:10:54.039478 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.039478 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="87737711-5fbf-4a19-99f1-430d05a3e863" containerName="manager" Jul 07 01:10:54.045958 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.045939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:10:54.049891 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.049871 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jtxhz\"" Jul 07 01:10:54.050218 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.050201 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 07 01:10:54.057227 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.057205 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-cc8d47df9-zd6rt"] Jul 07 01:10:54.204025 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.203994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dblxl\" (UniqueName: \"kubernetes.io/projected/e6d60e85-3d6e-4e89-9ce1-ccd8f976f501-kube-api-access-dblxl\") pod \"maas-api-cc8d47df9-zd6rt\" (UID: \"e6d60e85-3d6e-4e89-9ce1-ccd8f976f501\") " pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:10:54.204196 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.204134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6d60e85-3d6e-4e89-9ce1-ccd8f976f501-maas-api-tls\") pod \"maas-api-cc8d47df9-zd6rt\" (UID: \"e6d60e85-3d6e-4e89-9ce1-ccd8f976f501\") " pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:10:54.204196 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.204173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6d60e85-3d6e-4e89-9ce1-ccd8f976f501-openshift-service-ca\") pod \"maas-api-cc8d47df9-zd6rt\" (UID: \"e6d60e85-3d6e-4e89-9ce1-ccd8f976f501\") " pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:10:54.305106 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.305017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6d60e85-3d6e-4e89-9ce1-ccd8f976f501-maas-api-tls\") pod \"maas-api-cc8d47df9-zd6rt\" (UID: \"e6d60e85-3d6e-4e89-9ce1-ccd8f976f501\") " pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:10:54.305106 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.305070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6d60e85-3d6e-4e89-9ce1-ccd8f976f501-openshift-service-ca\") pod \"maas-api-cc8d47df9-zd6rt\" (UID: \"e6d60e85-3d6e-4e89-9ce1-ccd8f976f501\") " pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:10:54.305404 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.305121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dblxl\" (UniqueName: \"kubernetes.io/projected/e6d60e85-3d6e-4e89-9ce1-ccd8f976f501-kube-api-access-dblxl\") pod \"maas-api-cc8d47df9-zd6rt\" (UID: \"e6d60e85-3d6e-4e89-9ce1-ccd8f976f501\") " pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:10:54.305803 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.305778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6d60e85-3d6e-4e89-9ce1-ccd8f976f501-openshift-service-ca\") pod \"maas-api-cc8d47df9-zd6rt\" (UID: \"e6d60e85-3d6e-4e89-9ce1-ccd8f976f501\") " pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:10:54.307720 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.307700 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6d60e85-3d6e-4e89-9ce1-ccd8f976f501-maas-api-tls\") pod \"maas-api-cc8d47df9-zd6rt\" (UID: \"e6d60e85-3d6e-4e89-9ce1-ccd8f976f501\") " pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:10:54.313066 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.313032 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dblxl\" (UniqueName: \"kubernetes.io/projected/e6d60e85-3d6e-4e89-9ce1-ccd8f976f501-kube-api-access-dblxl\") pod \"maas-api-cc8d47df9-zd6rt\" (UID: \"e6d60e85-3d6e-4e89-9ce1-ccd8f976f501\") " pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:10:54.356916 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.356883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:10:54.501846 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.501823 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-cc8d47df9-zd6rt"] Jul 07 01:10:54.504162 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:10:54.504121 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d60e85_3d6e_4e89_9ce1_ccd8f976f501.slice/crio-18c7c30446b8f8bcbb84115813727d85bb2c85e83562b669b27c619b41c6a093 WatchSource:0}: Error finding container 18c7c30446b8f8bcbb84115813727d85bb2c85e83562b669b27c619b41c6a093: Status 404 returned error can't find the container with id 18c7c30446b8f8bcbb84115813727d85bb2c85e83562b669b27c619b41c6a093 Jul 07 01:10:54.529708 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.529448 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-4zvps"] Jul 07 01:10:54.537343 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.537316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" Jul 07 01:10:54.540460 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.540431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 01:10:54.540460 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.540447 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8q99v\"" Jul 07 01:10:54.541935 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.541914 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-4zvps"] Jul 07 01:10:54.709121 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.709087 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba839f97-a5b7-47d7-852b-b98e63a612d5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-4zvps\" (UID: \"ba839f97-a5b7-47d7-852b-b98e63a612d5\") " pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" Jul 07 01:10:54.709121 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.709124 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jhm2\" (UniqueName: \"kubernetes.io/projected/ba839f97-a5b7-47d7-852b-b98e63a612d5-kube-api-access-7jhm2\") pod \"payload-pre-processing-7964457696-4zvps\" (UID: \"ba839f97-a5b7-47d7-852b-b98e63a612d5\") " pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" Jul 07 01:10:54.810446 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.810411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba839f97-a5b7-47d7-852b-b98e63a612d5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-4zvps\" (UID: \"ba839f97-a5b7-47d7-852b-b98e63a612d5\") " pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" Jul 07 01:10:54.810446 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.810445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jhm2\" (UniqueName: \"kubernetes.io/projected/ba839f97-a5b7-47d7-852b-b98e63a612d5-kube-api-access-7jhm2\") pod \"payload-pre-processing-7964457696-4zvps\" (UID: \"ba839f97-a5b7-47d7-852b-b98e63a612d5\") " pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" Jul 07 01:10:54.811087 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.811068 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba839f97-a5b7-47d7-852b-b98e63a612d5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-4zvps\" (UID: \"ba839f97-a5b7-47d7-852b-b98e63a612d5\") " pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" Jul 07 01:10:54.818438 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.818415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jhm2\" (UniqueName: \"kubernetes.io/projected/ba839f97-a5b7-47d7-852b-b98e63a612d5-kube-api-access-7jhm2\") pod \"payload-pre-processing-7964457696-4zvps\" (UID: \"ba839f97-a5b7-47d7-852b-b98e63a612d5\") " pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" Jul 07 01:10:54.851448 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.851414 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" Jul 07 01:10:54.986385 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:54.986360 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-4zvps"] Jul 07 01:10:54.987989 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:10:54.987959 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba839f97_a5b7_47d7_852b_b98e63a612d5.slice/crio-1fe530ff5e588f90c1e63405f5237f26a8f5f18575a783d428bdabad01f63b87 WatchSource:0}: Error finding container 1fe530ff5e588f90c1e63405f5237f26a8f5f18575a783d428bdabad01f63b87: Status 404 returned error can't find the container with id 1fe530ff5e588f90c1e63405f5237f26a8f5f18575a783d428bdabad01f63b87 Jul 07 01:10:55.449328 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:55.449285 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" event={"ID":"ba839f97-a5b7-47d7-852b-b98e63a612d5","Type":"ContainerStarted","Data":"1fe530ff5e588f90c1e63405f5237f26a8f5f18575a783d428bdabad01f63b87"} Jul 07 01:10:55.450463 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:55.450443 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-cc8d47df9-zd6rt" event={"ID":"e6d60e85-3d6e-4e89-9ce1-ccd8f976f501","Type":"ContainerStarted","Data":"18c7c30446b8f8bcbb84115813727d85bb2c85e83562b669b27c619b41c6a093"} Jul 07 01:10:57.463043 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:57.463005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-cc8d47df9-zd6rt" event={"ID":"e6d60e85-3d6e-4e89-9ce1-ccd8f976f501","Type":"ContainerStarted","Data":"c3d1b2a2d773de17c28e0a9f4e63cd528207ff5b39c5e3cd42b5846868ec8ba6"} Jul 07 01:10:57.463554 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:57.463092 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:10:57.464587 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:57.464564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" event={"ID":"ba839f97-a5b7-47d7-852b-b98e63a612d5","Type":"ContainerStarted","Data":"063c4f59b20636e976498b6452b13345fa2847f35179ecc22508f1e536613649"} Jul 07 01:10:57.464707 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:57.464683 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" Jul 07 01:10:57.480920 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:57.480873 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-cc8d47df9-zd6rt" podStartSLOduration=1.108868754 podStartE2EDuration="3.480859881s" totalImagesPullingTime="2.371991127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:10:57.478163498 +0000 UTC m=+583.484570283" watchObservedRunningTime="2026-07-07 01:10:57.480859881 +0000 UTC m=+583.487266654" Jul 07 01:10:57.494984 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:10:57.494931 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" podStartSLOduration=1.6098152639999999 podStartE2EDuration="3.49491519s" totalImagesPullingTime="1.885099926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:10:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:10:57.493509125 +0000 UTC m=+583.499915909" watchObservedRunningTime="2026-07-07 01:10:57.49491519 +0000 UTC m=+583.501321972" Jul 07 01:11:03.481726 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:11:03.481694 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-cc8d47df9-zd6rt" Jul 07 01:11:08.478607 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:11:08.478575 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-4zvps" Jul 07 01:15:00.142375 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:00.142336 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723115-bqllk"] Jul 07 01:15:00.146428 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:00.146407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723115-bqllk" Jul 07 01:15:00.158308 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:00.158277 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723115-bqllk"] Jul 07 01:15:00.272782 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:00.272748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7pw9\" (UniqueName: \"kubernetes.io/projected/731ba782-1d7a-4848-9117-655b2287a639-kube-api-access-x7pw9\") pod \"maas-api-key-cleanup-29723115-bqllk\" (UID: \"731ba782-1d7a-4848-9117-655b2287a639\") " pod="opendatahub/maas-api-key-cleanup-29723115-bqllk" Jul 07 01:15:00.374210 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:00.374180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7pw9\" (UniqueName: \"kubernetes.io/projected/731ba782-1d7a-4848-9117-655b2287a639-kube-api-access-x7pw9\") pod \"maas-api-key-cleanup-29723115-bqllk\" (UID: \"731ba782-1d7a-4848-9117-655b2287a639\") " pod="opendatahub/maas-api-key-cleanup-29723115-bqllk" Jul 07 01:15:00.382712 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:00.382682 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7pw9\" (UniqueName: \"kubernetes.io/projected/731ba782-1d7a-4848-9117-655b2287a639-kube-api-access-x7pw9\") pod \"maas-api-key-cleanup-29723115-bqllk\" (UID: \"731ba782-1d7a-4848-9117-655b2287a639\") " pod="opendatahub/maas-api-key-cleanup-29723115-bqllk" Jul 07 01:15:00.457376 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:00.457304 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723115-bqllk" Jul 07 01:15:00.587815 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:00.587495 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723115-bqllk"] Jul 07 01:15:00.590036 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:15:00.589998 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod731ba782_1d7a_4848_9117_655b2287a639.slice/crio-81eab45083335fefe649db1ca14dab9b45c4800fe304a047d33c5f3283310ab5 WatchSource:0}: Error finding container 81eab45083335fefe649db1ca14dab9b45c4800fe304a047d33c5f3283310ab5: Status 404 returned error can't find the container with id 81eab45083335fefe649db1ca14dab9b45c4800fe304a047d33c5f3283310ab5 Jul 07 01:15:00.592076 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:00.592058 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 01:15:00.635046 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:00.635012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723115-bqllk" event={"ID":"731ba782-1d7a-4848-9117-655b2287a639","Type":"ContainerStarted","Data":"81eab45083335fefe649db1ca14dab9b45c4800fe304a047d33c5f3283310ab5"} Jul 07 01:15:03.651861 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:03.651778 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723115-bqllk" event={"ID":"731ba782-1d7a-4848-9117-655b2287a639","Type":"ContainerStarted","Data":"12283fe88b4158c4c396fc2f4b1ae324463389c2a71077e6e0d7586144ca71b3"} Jul 07 01:15:03.667902 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:03.667848 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723115-bqllk" podStartSLOduration=1.173511038 podStartE2EDuration="3.667831816s" totalImagesPullingTime="2.494320778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:15:03.667615173 +0000 UTC m=+829.674021972" watchObservedRunningTime="2026-07-07 01:15:03.667831816 +0000 UTC m=+829.674238596" Jul 07 01:15:04.658287 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:04.658237 2576 generic.go:356] "Generic (PLEG): container finished" podID="731ba782-1d7a-4848-9117-655b2287a639" containerID="12283fe88b4158c4c396fc2f4b1ae324463389c2a71077e6e0d7586144ca71b3" exitCode=0 Jul 07 01:15:04.658657 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:04.658324 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723115-bqllk" event={"ID":"731ba782-1d7a-4848-9117-655b2287a639","Type":"ContainerDied","Data":"12283fe88b4158c4c396fc2f4b1ae324463389c2a71077e6e0d7586144ca71b3"} Jul 07 01:15:05.796606 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:05.796582 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723115-bqllk" Jul 07 01:15:05.929655 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:05.929567 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7pw9\" (UniqueName: \"kubernetes.io/projected/731ba782-1d7a-4848-9117-655b2287a639-kube-api-access-x7pw9\") pod \"731ba782-1d7a-4848-9117-655b2287a639\" (UID: \"731ba782-1d7a-4848-9117-655b2287a639\") " Jul 07 01:15:05.931811 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:05.931786 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/731ba782-1d7a-4848-9117-655b2287a639-kube-api-access-x7pw9" (OuterVolumeSpecName: "kube-api-access-x7pw9") pod "731ba782-1d7a-4848-9117-655b2287a639" (UID: "731ba782-1d7a-4848-9117-655b2287a639"). InnerVolumeSpecName "kube-api-access-x7pw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:15:06.030508 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:06.030469 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7pw9\" (UniqueName: \"kubernetes.io/projected/731ba782-1d7a-4848-9117-655b2287a639-kube-api-access-x7pw9\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:15:06.669116 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:06.669067 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723115-bqllk" Jul 07 01:15:06.669333 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:06.669118 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723115-bqllk" event={"ID":"731ba782-1d7a-4848-9117-655b2287a639","Type":"ContainerDied","Data":"81eab45083335fefe649db1ca14dab9b45c4800fe304a047d33c5f3283310ab5"} Jul 07 01:15:06.669333 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:15:06.669165 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81eab45083335fefe649db1ca14dab9b45c4800fe304a047d33c5f3283310ab5" Jul 07 01:16:25.195121 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.195085 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6567c79cc6-n2psk"] Jul 07 01:16:25.197508 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.195500 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="731ba782-1d7a-4848-9117-655b2287a639" containerName="cleanup" Jul 07 01:16:25.197508 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.195512 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="731ba782-1d7a-4848-9117-655b2287a639" containerName="cleanup" Jul 07 01:16:25.197508 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.195579 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="731ba782-1d7a-4848-9117-655b2287a639" containerName="cleanup" Jul 07 01:16:25.198446 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.198431 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6567c79cc6-n2psk" Jul 07 01:16:25.201347 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.201316 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 01:16:25.205177 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.205154 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6567c79cc6-n2psk"] Jul 07 01:16:25.250604 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.250577 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65fd620f-64e1-4430-9447-aae600e11c16-tls-cert\") pod \"authorino-6567c79cc6-n2psk\" (UID: \"65fd620f-64e1-4430-9447-aae600e11c16\") " pod="kuadrant-system/authorino-6567c79cc6-n2psk" Jul 07 01:16:25.250758 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.250636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpxjh\" (UniqueName: \"kubernetes.io/projected/65fd620f-64e1-4430-9447-aae600e11c16-kube-api-access-jpxjh\") pod \"authorino-6567c79cc6-n2psk\" (UID: \"65fd620f-64e1-4430-9447-aae600e11c16\") " pod="kuadrant-system/authorino-6567c79cc6-n2psk" Jul 07 01:16:25.351539 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.351495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpxjh\" (UniqueName: \"kubernetes.io/projected/65fd620f-64e1-4430-9447-aae600e11c16-kube-api-access-jpxjh\") pod \"authorino-6567c79cc6-n2psk\" (UID: \"65fd620f-64e1-4430-9447-aae600e11c16\") " pod="kuadrant-system/authorino-6567c79cc6-n2psk" Jul 07 01:16:25.351735 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.351621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65fd620f-64e1-4430-9447-aae600e11c16-tls-cert\") pod \"authorino-6567c79cc6-n2psk\" (UID: \"65fd620f-64e1-4430-9447-aae600e11c16\") " pod="kuadrant-system/authorino-6567c79cc6-n2psk" Jul 07 01:16:25.354151 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.354127 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65fd620f-64e1-4430-9447-aae600e11c16-tls-cert\") pod \"authorino-6567c79cc6-n2psk\" (UID: \"65fd620f-64e1-4430-9447-aae600e11c16\") " pod="kuadrant-system/authorino-6567c79cc6-n2psk" Jul 07 01:16:25.359667 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.359642 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpxjh\" (UniqueName: \"kubernetes.io/projected/65fd620f-64e1-4430-9447-aae600e11c16-kube-api-access-jpxjh\") pod \"authorino-6567c79cc6-n2psk\" (UID: \"65fd620f-64e1-4430-9447-aae600e11c16\") " pod="kuadrant-system/authorino-6567c79cc6-n2psk" Jul 07 01:16:25.509071 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.508976 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6567c79cc6-n2psk" Jul 07 01:16:25.646352 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:25.646326 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6567c79cc6-n2psk"] Jul 07 01:16:25.648016 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:16:25.647990 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65fd620f_64e1_4430_9447_aae600e11c16.slice/crio-3f55ac9417c4073eee0434884cb8744a7bf7fc199cc1b77dbb64baa6a841751a WatchSource:0}: Error finding container 3f55ac9417c4073eee0434884cb8744a7bf7fc199cc1b77dbb64baa6a841751a: Status 404 returned error can't find the container with id 3f55ac9417c4073eee0434884cb8744a7bf7fc199cc1b77dbb64baa6a841751a Jul 07 01:16:26.074184 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:26.074148 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6567c79cc6-n2psk" event={"ID":"65fd620f-64e1-4430-9447-aae600e11c16","Type":"ContainerStarted","Data":"3f55ac9417c4073eee0434884cb8744a7bf7fc199cc1b77dbb64baa6a841751a"} Jul 07 01:16:27.080991 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:27.080952 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6567c79cc6-n2psk" event={"ID":"65fd620f-64e1-4430-9447-aae600e11c16","Type":"ContainerStarted","Data":"0055ba1569f7c07ed15fcf8edfc35c3e2ad8560ab3d2b7848d67898ebf43260e"} Jul 07 01:16:27.098887 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:27.098834 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6567c79cc6-n2psk" podStartSLOduration=1.630601403 podStartE2EDuration="2.098817436s" totalImagesPullingTime="468.216033ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:16:27.096687229 +0000 UTC m=+913.103094011" watchObservedRunningTime="2026-07-07 01:16:27.098817436 +0000 UTC m=+913.105224217" Jul 07 01:16:27.122832 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:27.122801 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-595bd9988f-fnznh"] Jul 07 01:16:27.123055 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:27.123024 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-595bd9988f-fnznh" podUID="62982204-89ea-413a-afd2-1860e8a5457f" containerName="authorino" containerID="cri-o://e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce" gracePeriod=30 Jul 07 01:16:27.370790 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:27.370764 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-595bd9988f-fnznh" Jul 07 01:16:27.472190 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:27.472155 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmq6h\" (UniqueName: \"kubernetes.io/projected/62982204-89ea-413a-afd2-1860e8a5457f-kube-api-access-jmq6h\") pod \"62982204-89ea-413a-afd2-1860e8a5457f\" (UID: \"62982204-89ea-413a-afd2-1860e8a5457f\") " Jul 07 01:16:27.474544 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:27.474510 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62982204-89ea-413a-afd2-1860e8a5457f-kube-api-access-jmq6h" (OuterVolumeSpecName: "kube-api-access-jmq6h") pod "62982204-89ea-413a-afd2-1860e8a5457f" (UID: "62982204-89ea-413a-afd2-1860e8a5457f"). InnerVolumeSpecName "kube-api-access-jmq6h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:16:27.573611 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:27.573578 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmq6h\" (UniqueName: \"kubernetes.io/projected/62982204-89ea-413a-afd2-1860e8a5457f-kube-api-access-jmq6h\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:16:28.087167 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:28.087132 2576 generic.go:356] "Generic (PLEG): container finished" podID="62982204-89ea-413a-afd2-1860e8a5457f" containerID="e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce" exitCode=0 Jul 07 01:16:28.087773 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:28.087175 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-595bd9988f-fnznh" Jul 07 01:16:28.087773 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:28.087228 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-595bd9988f-fnznh" event={"ID":"62982204-89ea-413a-afd2-1860e8a5457f","Type":"ContainerDied","Data":"e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce"} Jul 07 01:16:28.087773 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:28.087301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-595bd9988f-fnznh" event={"ID":"62982204-89ea-413a-afd2-1860e8a5457f","Type":"ContainerDied","Data":"5fc204580af1c9e0329c59532baf263d90acdee50de1113b0b021ed4c725a0a1"} Jul 07 01:16:28.087773 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:28.087334 2576 scope.go:117] "RemoveContainer" containerID="e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce" Jul 07 01:16:28.098109 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:28.098090 2576 scope.go:117] "RemoveContainer" containerID="e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce" Jul 07 01:16:28.098448 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:16:28.098428 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce\": container with ID starting with e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce not found: ID does not exist" containerID="e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce" Jul 07 01:16:28.098510 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:28.098457 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce"} err="failed to get container status \"e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce\": rpc error: code = NotFound desc = could not find container \"e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce\": container with ID starting with e0726fbf70d7b919b2dfdbe8f8c0d1213965a991429437993d056563c4b48fce not found: ID does not exist" Jul 07 01:16:28.108721 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:28.108696 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-595bd9988f-fnznh"] Jul 07 01:16:28.112874 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:28.112851 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-595bd9988f-fnznh"] Jul 07 01:16:28.551078 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:16:28.550638 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62982204-89ea-413a-afd2-1860e8a5457f" path="/var/lib/kubelet/pods/62982204-89ea-413a-afd2-1860e8a5457f/volumes" Jul 07 01:17:39.212671 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:39.212590 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dccc95f8-v99b6"] Jul 07 01:17:39.213288 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:39.212803 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-75dccc95f8-v99b6" podUID="0e694b4b-64f5-4765-ba76-97b23af8cda2" containerName="manager" containerID="cri-o://247ae1050e06d924c9ca28f226301da7435855665f68eb3a0501a0a80a168e1d" gracePeriod=30 Jul 07 01:17:39.444658 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:39.444620 2576 generic.go:356] "Generic (PLEG): container finished" podID="0e694b4b-64f5-4765-ba76-97b23af8cda2" containerID="247ae1050e06d924c9ca28f226301da7435855665f68eb3a0501a0a80a168e1d" exitCode=0 Jul 07 01:17:39.444658 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:39.444640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dccc95f8-v99b6" event={"ID":"0e694b4b-64f5-4765-ba76-97b23af8cda2","Type":"ContainerDied","Data":"247ae1050e06d924c9ca28f226301da7435855665f68eb3a0501a0a80a168e1d"} Jul 07 01:17:39.465232 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:39.465175 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:17:39.552634 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:39.552593 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z58cj\" (UniqueName: \"kubernetes.io/projected/0e694b4b-64f5-4765-ba76-97b23af8cda2-kube-api-access-z58cj\") pod \"0e694b4b-64f5-4765-ba76-97b23af8cda2\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " Jul 07 01:17:39.552634 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:39.552629 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert\") pod \"0e694b4b-64f5-4765-ba76-97b23af8cda2\" (UID: \"0e694b4b-64f5-4765-ba76-97b23af8cda2\") " Jul 07 01:17:39.554771 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:39.554748 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0e694b4b-64f5-4765-ba76-97b23af8cda2" (UID: "0e694b4b-64f5-4765-ba76-97b23af8cda2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:17:39.554928 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:39.554909 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e694b4b-64f5-4765-ba76-97b23af8cda2-kube-api-access-z58cj" (OuterVolumeSpecName: "kube-api-access-z58cj") pod "0e694b4b-64f5-4765-ba76-97b23af8cda2" (UID: "0e694b4b-64f5-4765-ba76-97b23af8cda2"). InnerVolumeSpecName "kube-api-access-z58cj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:17:39.653724 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:39.653691 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z58cj\" (UniqueName: \"kubernetes.io/projected/0e694b4b-64f5-4765-ba76-97b23af8cda2-kube-api-access-z58cj\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:17:39.653724 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:39.653721 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e694b4b-64f5-4765-ba76-97b23af8cda2-webhook-cert\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:17:40.451205 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:40.451175 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dccc95f8-v99b6" Jul 07 01:17:40.451205 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:40.451184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dccc95f8-v99b6" event={"ID":"0e694b4b-64f5-4765-ba76-97b23af8cda2","Type":"ContainerDied","Data":"be8d9b4c0d86998bdba13f7fff7452c00d70197751da89a4fa1499f3758745f6"} Jul 07 01:17:40.451736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:40.451250 2576 scope.go:117] "RemoveContainer" containerID="247ae1050e06d924c9ca28f226301da7435855665f68eb3a0501a0a80a168e1d" Jul 07 01:17:40.472312 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:40.472286 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dccc95f8-v99b6"] Jul 07 01:17:40.476197 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:40.476178 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75dccc95f8-v99b6"] Jul 07 01:17:40.548760 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:40.548732 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e694b4b-64f5-4765-ba76-97b23af8cda2" path="/var/lib/kubelet/pods/0e694b4b-64f5-4765-ba76-97b23af8cda2/volumes" Jul 07 01:17:41.213270 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.213243 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dccc95f8-g52dq"] Jul 07 01:17:41.213650 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.213636 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62982204-89ea-413a-afd2-1860e8a5457f" containerName="authorino" Jul 07 01:17:41.213711 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.213651 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="62982204-89ea-413a-afd2-1860e8a5457f" containerName="authorino" Jul 07 01:17:41.213711 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.213669 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e694b4b-64f5-4765-ba76-97b23af8cda2" containerName="manager" Jul 07 01:17:41.213711 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.213674 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e694b4b-64f5-4765-ba76-97b23af8cda2" containerName="manager" Jul 07 01:17:41.213823 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.213739 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="62982204-89ea-413a-afd2-1860e8a5457f" containerName="authorino" Jul 07 01:17:41.213823 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.213748 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e694b4b-64f5-4765-ba76-97b23af8cda2" containerName="manager" Jul 07 01:17:41.218087 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.218067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dccc95f8-g52dq" Jul 07 01:17:41.222662 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.222641 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 01:17:41.222662 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.222660 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 01:17:41.222829 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.222678 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mb89m\"" Jul 07 01:17:41.227280 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.227241 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dccc95f8-g52dq"] Jul 07 01:17:41.265550 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.265521 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/696c2eb5-b1da-48b7-a0c7-b5303c5029b0-webhook-cert\") pod \"maas-controller-75dccc95f8-g52dq\" (UID: \"696c2eb5-b1da-48b7-a0c7-b5303c5029b0\") " pod="opendatahub/maas-controller-75dccc95f8-g52dq" Jul 07 01:17:41.265682 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.265582 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntmr8\" (UniqueName: \"kubernetes.io/projected/696c2eb5-b1da-48b7-a0c7-b5303c5029b0-kube-api-access-ntmr8\") pod \"maas-controller-75dccc95f8-g52dq\" (UID: \"696c2eb5-b1da-48b7-a0c7-b5303c5029b0\") " pod="opendatahub/maas-controller-75dccc95f8-g52dq" Jul 07 01:17:41.366363 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.366309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntmr8\" (UniqueName: \"kubernetes.io/projected/696c2eb5-b1da-48b7-a0c7-b5303c5029b0-kube-api-access-ntmr8\") pod \"maas-controller-75dccc95f8-g52dq\" (UID: \"696c2eb5-b1da-48b7-a0c7-b5303c5029b0\") " pod="opendatahub/maas-controller-75dccc95f8-g52dq" Jul 07 01:17:41.366567 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.366430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/696c2eb5-b1da-48b7-a0c7-b5303c5029b0-webhook-cert\") pod \"maas-controller-75dccc95f8-g52dq\" (UID: \"696c2eb5-b1da-48b7-a0c7-b5303c5029b0\") " pod="opendatahub/maas-controller-75dccc95f8-g52dq" Jul 07 01:17:41.369106 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.369081 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/696c2eb5-b1da-48b7-a0c7-b5303c5029b0-webhook-cert\") pod \"maas-controller-75dccc95f8-g52dq\" (UID: \"696c2eb5-b1da-48b7-a0c7-b5303c5029b0\") " pod="opendatahub/maas-controller-75dccc95f8-g52dq" Jul 07 01:17:41.374415 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.374392 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntmr8\" (UniqueName: \"kubernetes.io/projected/696c2eb5-b1da-48b7-a0c7-b5303c5029b0-kube-api-access-ntmr8\") pod \"maas-controller-75dccc95f8-g52dq\" (UID: \"696c2eb5-b1da-48b7-a0c7-b5303c5029b0\") " pod="opendatahub/maas-controller-75dccc95f8-g52dq" Jul 07 01:17:41.529043 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.528953 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dccc95f8-g52dq" Jul 07 01:17:41.661427 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:41.661405 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dccc95f8-g52dq"] Jul 07 01:17:41.663777 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:17:41.663748 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696c2eb5_b1da_48b7_a0c7_b5303c5029b0.slice/crio-e88851635da15b98a1cb2983b5d7a24321f533afda9576f1a04931846a129d87 WatchSource:0}: Error finding container e88851635da15b98a1cb2983b5d7a24321f533afda9576f1a04931846a129d87: Status 404 returned error can't find the container with id e88851635da15b98a1cb2983b5d7a24321f533afda9576f1a04931846a129d87 Jul 07 01:17:42.463708 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:42.463671 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dccc95f8-g52dq" event={"ID":"696c2eb5-b1da-48b7-a0c7-b5303c5029b0","Type":"ContainerStarted","Data":"5494939e0b7aa03da97f6146b4db2cc1033b07a650b9a27ca79633ccc87c7f73"} Jul 07 01:17:42.463882 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:42.463732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dccc95f8-g52dq" event={"ID":"696c2eb5-b1da-48b7-a0c7-b5303c5029b0","Type":"ContainerStarted","Data":"e88851635da15b98a1cb2983b5d7a24321f533afda9576f1a04931846a129d87"} Jul 07 01:17:42.463882 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:42.463760 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dccc95f8-g52dq" Jul 07 01:17:42.480702 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:42.480655 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dccc95f8-g52dq" podStartSLOduration=0.894218292 podStartE2EDuration="1.480637929s" totalImagesPullingTime="586.419637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:17:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:17:42.479125715 +0000 UTC m=+988.485532508" watchObservedRunningTime="2026-07-07 01:17:42.480637929 +0000 UTC m=+988.487044711" Jul 07 01:17:53.475178 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:17:53.475150 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dccc95f8-g52dq" Jul 07 01:23:31.315525 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:31.315480 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s"] Jul 07 01:23:31.320763 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:31.320737 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" Jul 07 01:23:31.324001 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:31.323971 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dvc5k\"" Jul 07 01:23:31.327393 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:31.327370 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s"] Jul 07 01:23:31.354804 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:31.354774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4s4n\" (UniqueName: \"kubernetes.io/projected/a004afb1-88b2-4f11-81d0-a77d1c610e5e-kube-api-access-h4s4n\") pod \"kuadrant-operator-controller-manager-86878c769f-cm94s\" (UID: \"a004afb1-88b2-4f11-81d0-a77d1c610e5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" Jul 07 01:23:31.354952 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:31.354849 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a004afb1-88b2-4f11-81d0-a77d1c610e5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cm94s\" (UID: \"a004afb1-88b2-4f11-81d0-a77d1c610e5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" Jul 07 01:23:31.456373 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:31.456334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4s4n\" (UniqueName: \"kubernetes.io/projected/a004afb1-88b2-4f11-81d0-a77d1c610e5e-kube-api-access-h4s4n\") pod \"kuadrant-operator-controller-manager-86878c769f-cm94s\" (UID: \"a004afb1-88b2-4f11-81d0-a77d1c610e5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" Jul 07 01:23:31.456547 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:31.456414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a004afb1-88b2-4f11-81d0-a77d1c610e5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cm94s\" (UID: \"a004afb1-88b2-4f11-81d0-a77d1c610e5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" Jul 07 01:23:31.456746 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:31.456730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a004afb1-88b2-4f11-81d0-a77d1c610e5e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cm94s\" (UID: \"a004afb1-88b2-4f11-81d0-a77d1c610e5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" Jul 07 01:23:31.465973 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:31.465941 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4s4n\" (UniqueName: \"kubernetes.io/projected/a004afb1-88b2-4f11-81d0-a77d1c610e5e-kube-api-access-h4s4n\") pod \"kuadrant-operator-controller-manager-86878c769f-cm94s\" (UID: \"a004afb1-88b2-4f11-81d0-a77d1c610e5e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" Jul 07 01:23:31.633345 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:31.633309 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" Jul 07 01:23:31.788977 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:31.788952 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s"] Jul 07 01:23:31.791534 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:23:31.791504 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda004afb1_88b2_4f11_81d0_a77d1c610e5e.slice/crio-bd402299da455b367b3c63fa2971d5866ce07d6e26a3f3b3b4675f53f556173b WatchSource:0}: Error finding container bd402299da455b367b3c63fa2971d5866ce07d6e26a3f3b3b4675f53f556173b: Status 404 returned error can't find the container with id bd402299da455b367b3c63fa2971d5866ce07d6e26a3f3b3b4675f53f556173b Jul 07 01:23:32.200236 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:32.200199 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" event={"ID":"a004afb1-88b2-4f11-81d0-a77d1c610e5e","Type":"ContainerStarted","Data":"eb5826837126bced25183286619e07e36bb32554215164c37def7d9fa80aa9ff"} Jul 07 01:23:32.200456 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:32.200287 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" event={"ID":"a004afb1-88b2-4f11-81d0-a77d1c610e5e","Type":"ContainerStarted","Data":"bd402299da455b367b3c63fa2971d5866ce07d6e26a3f3b3b4675f53f556173b"} Jul 07 01:23:32.200456 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:32.200317 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" Jul 07 01:23:32.221091 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:32.221043 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" podStartSLOduration=1.221026125 podStartE2EDuration="1.221026125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:23:32.21867805 +0000 UTC m=+1338.225084833" watchObservedRunningTime="2026-07-07 01:23:32.221026125 +0000 UTC m=+1338.227432906" Jul 07 01:23:43.207393 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:23:43.207302 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cm94s" Jul 07 01:29:50.884990 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:50.884953 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd"] Jul 07 01:29:50.888747 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:50.888725 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:50.891610 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:50.891585 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-afa7395d-serving-cert\"" Jul 07 01:29:50.900291 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:50.900236 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd"] Jul 07 01:29:50.995448 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:50.995410 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-maas-api-tls\") pod \"maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd\" (UID: \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\") " pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:50.995668 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:50.995559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p42r\" (UniqueName: \"kubernetes.io/projected/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-kube-api-access-6p42r\") pod \"maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd\" (UID: \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\") " pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:50.995668 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:50.995617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-openshift-service-ca\") pod \"maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd\" (UID: \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\") " pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:51.096451 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:51.096414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-maas-api-tls\") pod \"maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd\" (UID: \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\") " pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:51.096662 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:51.096500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p42r\" (UniqueName: \"kubernetes.io/projected/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-kube-api-access-6p42r\") pod \"maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd\" (UID: \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\") " pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:51.096662 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:51.096546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-openshift-service-ca\") pod \"maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd\" (UID: \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\") " pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:51.097203 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:51.097181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-openshift-service-ca\") pod \"maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd\" (UID: \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\") " pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:51.098934 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:51.098910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-maas-api-tls\") pod \"maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd\" (UID: \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\") " pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:51.105034 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:51.105008 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p42r\" (UniqueName: \"kubernetes.io/projected/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-kube-api-access-6p42r\") pod \"maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd\" (UID: \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\") " pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:51.203806 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:51.203723 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:51.351843 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:51.351811 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd"] Jul 07 01:29:51.354044 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:29:51.354020 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4457dc91_98d9_4c3f_bf6f_1ad68146f84b.slice/crio-93772db95571fc2fd8fb94ac77fbfaa71583a6bd637feb285d6fa8109512a68a WatchSource:0}: Error finding container 93772db95571fc2fd8fb94ac77fbfaa71583a6bd637feb285d6fa8109512a68a: Status 404 returned error can't find the container with id 93772db95571fc2fd8fb94ac77fbfaa71583a6bd637feb285d6fa8109512a68a Jul 07 01:29:51.355542 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:51.355520 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 01:29:52.127724 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:52.127692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" event={"ID":"4457dc91-98d9-4c3f-bf6f-1ad68146f84b","Type":"ContainerStarted","Data":"6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc"} Jul 07 01:29:52.128197 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:52.127745 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" event={"ID":"4457dc91-98d9-4c3f-bf6f-1ad68146f84b","Type":"ContainerStarted","Data":"93772db95571fc2fd8fb94ac77fbfaa71583a6bd637feb285d6fa8109512a68a"} Jul 07 01:29:52.128197 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:52.127771 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:52.160591 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:52.160542 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" podStartSLOduration=1.74807494 podStartE2EDuration="2.160524646s" totalImagesPullingTime="412.449706ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:29:52.158762571 +0000 UTC m=+1718.165169387" watchObservedRunningTime="2026-07-07 01:29:52.160524646 +0000 UTC m=+1718.166931428" Jul 07 01:29:56.269843 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.269808 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd"] Jul 07 01:29:56.270397 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.270085 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" podUID="4457dc91-98d9-4c3f-bf6f-1ad68146f84b" containerName="maas-api" containerID="cri-o://6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc" gracePeriod=30 Jul 07 01:29:56.275953 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.275926 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:56.526312 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.526230 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:56.655835 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.655804 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p42r\" (UniqueName: \"kubernetes.io/projected/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-kube-api-access-6p42r\") pod \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\" (UID: \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\") " Jul 07 01:29:56.656026 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.655864 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-maas-api-tls\") pod \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\" (UID: \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\") " Jul 07 01:29:56.656026 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.655891 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-openshift-service-ca\") pod \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\" (UID: \"4457dc91-98d9-4c3f-bf6f-1ad68146f84b\") " Jul 07 01:29:56.656636 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.656611 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4457dc91-98d9-4c3f-bf6f-1ad68146f84b" (UID: "4457dc91-98d9-4c3f-bf6f-1ad68146f84b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:29:56.658233 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.658209 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-kube-api-access-6p42r" (OuterVolumeSpecName: "kube-api-access-6p42r") pod "4457dc91-98d9-4c3f-bf6f-1ad68146f84b" (UID: "4457dc91-98d9-4c3f-bf6f-1ad68146f84b"). InnerVolumeSpecName "kube-api-access-6p42r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:29:56.658402 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.658343 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4457dc91-98d9-4c3f-bf6f-1ad68146f84b" (UID: "4457dc91-98d9-4c3f-bf6f-1ad68146f84b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:29:56.757683 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.757626 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p42r\" (UniqueName: \"kubernetes.io/projected/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-kube-api-access-6p42r\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:29:56.757683 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.757677 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-maas-api-tls\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:29:56.757683 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:56.757691 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4457dc91-98d9-4c3f-bf6f-1ad68146f84b-openshift-service-ca\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:29:57.153620 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:57.153589 2576 generic.go:356] "Generic (PLEG): container finished" podID="4457dc91-98d9-4c3f-bf6f-1ad68146f84b" containerID="6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc" exitCode=0 Jul 07 01:29:57.153824 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:57.153685 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" event={"ID":"4457dc91-98d9-4c3f-bf6f-1ad68146f84b","Type":"ContainerDied","Data":"6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc"} Jul 07 01:29:57.153824 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:57.153705 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" Jul 07 01:29:57.153824 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:57.153727 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd" event={"ID":"4457dc91-98d9-4c3f-bf6f-1ad68146f84b","Type":"ContainerDied","Data":"93772db95571fc2fd8fb94ac77fbfaa71583a6bd637feb285d6fa8109512a68a"} Jul 07 01:29:57.153824 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:57.153750 2576 scope.go:117] "RemoveContainer" containerID="6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc" Jul 07 01:29:57.163075 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:57.163059 2576 scope.go:117] "RemoveContainer" containerID="6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc" Jul 07 01:29:57.163378 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:29:57.163357 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc\": container with ID starting with 6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc not found: ID does not exist" containerID="6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc" Jul 07 01:29:57.163443 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:57.163388 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc"} err="failed to get container status \"6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc\": rpc error: code = NotFound desc = could not find container \"6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc\": container with ID starting with 6983b9f20c455f469e9928159d861cfc92871ddfc8e60dca7fb4065907d774fc not found: ID does not exist" Jul 07 01:29:57.177144 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:57.177118 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd"] Jul 07 01:29:57.181172 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:57.181145 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-afa7395d-78966f59b8-2nfcd"] Jul 07 01:29:58.548954 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:29:58.548923 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4457dc91-98d9-4c3f-bf6f-1ad68146f84b" path="/var/lib/kubelet/pods/4457dc91-98d9-4c3f-bf6f-1ad68146f84b/volumes" Jul 07 01:30:03.139756 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.139722 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv"] Jul 07 01:30:03.140164 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.140149 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4457dc91-98d9-4c3f-bf6f-1ad68146f84b" containerName="maas-api" Jul 07 01:30:03.140164 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.140164 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4457dc91-98d9-4c3f-bf6f-1ad68146f84b" containerName="maas-api" Jul 07 01:30:03.140274 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.140228 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4457dc91-98d9-4c3f-bf6f-1ad68146f84b" containerName="maas-api" Jul 07 01:30:03.144879 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.144853 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:03.148173 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.148147 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-30ad23ec-serving-cert\"" Jul 07 01:30:03.160652 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.160623 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv"] Jul 07 01:30:03.220443 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.220408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/858d6117-e268-4e5a-9341-fdf925766cc3-maas-api-tls\") pod \"maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv\" (UID: \"858d6117-e268-4e5a-9341-fdf925766cc3\") " pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:03.220610 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.220453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/858d6117-e268-4e5a-9341-fdf925766cc3-openshift-service-ca\") pod \"maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv\" (UID: \"858d6117-e268-4e5a-9341-fdf925766cc3\") " pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:03.220610 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.220471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8782t\" (UniqueName: \"kubernetes.io/projected/858d6117-e268-4e5a-9341-fdf925766cc3-kube-api-access-8782t\") pod \"maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv\" (UID: \"858d6117-e268-4e5a-9341-fdf925766cc3\") " pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:03.321645 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.321606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8782t\" (UniqueName: \"kubernetes.io/projected/858d6117-e268-4e5a-9341-fdf925766cc3-kube-api-access-8782t\") pod \"maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv\" (UID: \"858d6117-e268-4e5a-9341-fdf925766cc3\") " pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:03.321846 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.321724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/858d6117-e268-4e5a-9341-fdf925766cc3-maas-api-tls\") pod \"maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv\" (UID: \"858d6117-e268-4e5a-9341-fdf925766cc3\") " pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:03.321846 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.321755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/858d6117-e268-4e5a-9341-fdf925766cc3-openshift-service-ca\") pod \"maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv\" (UID: \"858d6117-e268-4e5a-9341-fdf925766cc3\") " pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:03.322414 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.322387 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/858d6117-e268-4e5a-9341-fdf925766cc3-openshift-service-ca\") pod \"maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv\" (UID: \"858d6117-e268-4e5a-9341-fdf925766cc3\") " pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:03.324360 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.324339 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/858d6117-e268-4e5a-9341-fdf925766cc3-maas-api-tls\") pod \"maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv\" (UID: \"858d6117-e268-4e5a-9341-fdf925766cc3\") " pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:03.343252 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.343217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8782t\" (UniqueName: \"kubernetes.io/projected/858d6117-e268-4e5a-9341-fdf925766cc3-kube-api-access-8782t\") pod \"maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv\" (UID: \"858d6117-e268-4e5a-9341-fdf925766cc3\") " pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:03.457220 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.457134 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:03.598703 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:03.598678 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv"] Jul 07 01:30:03.600874 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:30:03.600850 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858d6117_e268_4e5a_9341_fdf925766cc3.slice/crio-37f8ee827e18c0faf4c141f335d1c079b514cd64a1ce53ea7564485cd98f977f WatchSource:0}: Error finding container 37f8ee827e18c0faf4c141f335d1c079b514cd64a1ce53ea7564485cd98f977f: Status 404 returned error can't find the container with id 37f8ee827e18c0faf4c141f335d1c079b514cd64a1ce53ea7564485cd98f977f Jul 07 01:30:04.195994 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:04.195951 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" event={"ID":"858d6117-e268-4e5a-9341-fdf925766cc3","Type":"ContainerStarted","Data":"1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f"} Jul 07 01:30:04.196487 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:04.196009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" event={"ID":"858d6117-e268-4e5a-9341-fdf925766cc3","Type":"ContainerStarted","Data":"37f8ee827e18c0faf4c141f335d1c079b514cd64a1ce53ea7564485cd98f977f"} Jul 07 01:30:04.196487 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:04.196042 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:04.215446 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:04.215401 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" podStartSLOduration=0.754477029 podStartE2EDuration="1.215385171s" totalImagesPullingTime="460.908142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:30:04.2123277 +0000 UTC m=+1730.218734495" watchObservedRunningTime="2026-07-07 01:30:04.215385171 +0000 UTC m=+1730.221791953" Jul 07 01:30:08.440771 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:08.440738 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv"] Jul 07 01:30:08.441238 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:08.440967 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" podUID="858d6117-e268-4e5a-9341-fdf925766cc3" containerName="maas-api" containerID="cri-o://1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f" gracePeriod=30 Jul 07 01:30:08.695972 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:08.695908 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:08.774803 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:08.774772 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/858d6117-e268-4e5a-9341-fdf925766cc3-openshift-service-ca\") pod \"858d6117-e268-4e5a-9341-fdf925766cc3\" (UID: \"858d6117-e268-4e5a-9341-fdf925766cc3\") " Jul 07 01:30:08.774969 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:08.774818 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8782t\" (UniqueName: \"kubernetes.io/projected/858d6117-e268-4e5a-9341-fdf925766cc3-kube-api-access-8782t\") pod \"858d6117-e268-4e5a-9341-fdf925766cc3\" (UID: \"858d6117-e268-4e5a-9341-fdf925766cc3\") " Jul 07 01:30:08.774969 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:08.774877 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/858d6117-e268-4e5a-9341-fdf925766cc3-maas-api-tls\") pod \"858d6117-e268-4e5a-9341-fdf925766cc3\" (UID: \"858d6117-e268-4e5a-9341-fdf925766cc3\") " Jul 07 01:30:08.775172 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:08.775144 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/858d6117-e268-4e5a-9341-fdf925766cc3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "858d6117-e268-4e5a-9341-fdf925766cc3" (UID: "858d6117-e268-4e5a-9341-fdf925766cc3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:30:08.776917 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:08.776891 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/858d6117-e268-4e5a-9341-fdf925766cc3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "858d6117-e268-4e5a-9341-fdf925766cc3" (UID: "858d6117-e268-4e5a-9341-fdf925766cc3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:30:08.777061 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:08.776990 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/858d6117-e268-4e5a-9341-fdf925766cc3-kube-api-access-8782t" (OuterVolumeSpecName: "kube-api-access-8782t") pod "858d6117-e268-4e5a-9341-fdf925766cc3" (UID: "858d6117-e268-4e5a-9341-fdf925766cc3"). InnerVolumeSpecName "kube-api-access-8782t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:30:08.876566 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:08.876535 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/858d6117-e268-4e5a-9341-fdf925766cc3-openshift-service-ca\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:30:08.876566 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:08.876560 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8782t\" (UniqueName: \"kubernetes.io/projected/858d6117-e268-4e5a-9341-fdf925766cc3-kube-api-access-8782t\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:30:08.876566 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:08.876570 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/858d6117-e268-4e5a-9341-fdf925766cc3-maas-api-tls\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:30:09.224778 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:09.224744 2576 generic.go:356] "Generic (PLEG): container finished" podID="858d6117-e268-4e5a-9341-fdf925766cc3" containerID="1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f" exitCode=0 Jul 07 01:30:09.224969 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:09.224794 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" Jul 07 01:30:09.224969 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:09.224832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" event={"ID":"858d6117-e268-4e5a-9341-fdf925766cc3","Type":"ContainerDied","Data":"1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f"} Jul 07 01:30:09.224969 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:09.224890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv" event={"ID":"858d6117-e268-4e5a-9341-fdf925766cc3","Type":"ContainerDied","Data":"37f8ee827e18c0faf4c141f335d1c079b514cd64a1ce53ea7564485cd98f977f"} Jul 07 01:30:09.224969 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:09.224920 2576 scope.go:117] "RemoveContainer" containerID="1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f" Jul 07 01:30:09.234203 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:09.234186 2576 scope.go:117] "RemoveContainer" containerID="1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f" Jul 07 01:30:09.234488 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:30:09.234471 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f\": container with ID starting with 1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f not found: ID does not exist" containerID="1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f" Jul 07 01:30:09.234536 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:09.234499 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f"} err="failed to get container status \"1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f\": rpc error: code = NotFound desc = could not find container \"1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f\": container with ID starting with 1a1dbb74ad4366d34755a3aafbf8edecee5708912b826077e1e5b12063f5368f not found: ID does not exist" Jul 07 01:30:09.246395 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:09.246368 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv"] Jul 07 01:30:09.250186 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:09.250165 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-30ad23ec-65f9d8cc7-hxrzv"] Jul 07 01:30:10.549320 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:10.549288 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="858d6117-e268-4e5a-9341-fdf925766cc3" path="/var/lib/kubelet/pods/858d6117-e268-4e5a-9341-fdf925766cc3/volumes" Jul 07 01:30:21.521624 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.521590 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf"] Jul 07 01:30:21.522069 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.522054 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="858d6117-e268-4e5a-9341-fdf925766cc3" containerName="maas-api" Jul 07 01:30:21.522116 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.522072 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="858d6117-e268-4e5a-9341-fdf925766cc3" containerName="maas-api" Jul 07 01:30:21.522152 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.522140 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="858d6117-e268-4e5a-9341-fdf925766cc3" containerName="maas-api" Jul 07 01:30:21.525376 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.525357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:21.528268 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.528242 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-5ec2bff8-serving-cert\"" Jul 07 01:30:21.534195 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.534172 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf"] Jul 07 01:30:21.597328 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.597250 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-openshift-service-ca\") pod \"maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:21.597328 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.597322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wq9j\" (UniqueName: \"kubernetes.io/projected/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-kube-api-access-6wq9j\") pod \"maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:21.597564 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.597377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-maas-api-tls\") pod \"maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:21.698453 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.698410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-openshift-service-ca\") pod \"maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:21.698453 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.698458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wq9j\" (UniqueName: \"kubernetes.io/projected/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-kube-api-access-6wq9j\") pod \"maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:21.698710 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.698508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-maas-api-tls\") pod \"maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:21.698710 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:30:21.698649 2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-5ec2bff8-serving-cert: secret "maas-api-e2e-derive-5ec2bff8-serving-cert" not found Jul 07 01:30:21.698824 ip-10-0-130-147 kubenswrapper[2576]: E0707 01:30:21.698723 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-maas-api-tls podName:7b805fdb-cb2d-4d41-8bc4-bb01493bf09b nodeName:}" failed. No retries permitted until 2026-07-07 01:30:22.19870303 +0000 UTC m=+1748.205109804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-maas-api-tls") pod "maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" (UID: "7b805fdb-cb2d-4d41-8bc4-bb01493bf09b") : secret "maas-api-e2e-derive-5ec2bff8-serving-cert" not found Jul 07 01:30:21.699131 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.699113 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-openshift-service-ca\") pod \"maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:21.707495 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:21.707472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wq9j\" (UniqueName: \"kubernetes.io/projected/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-kube-api-access-6wq9j\") pod \"maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:22.204185 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:22.204153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-maas-api-tls\") pod \"maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:22.206667 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:22.206643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-maas-api-tls\") pod \"maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:22.437894 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:22.437856 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:22.582065 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:22.582041 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf"] Jul 07 01:30:22.583966 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:30:22.583938 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b805fdb_cb2d_4d41_8bc4_bb01493bf09b.slice/crio-7b8525baa74c9d253f5310155a0bae631ae8b0dbc8f14791046fab8714796b6f WatchSource:0}: Error finding container 7b8525baa74c9d253f5310155a0bae631ae8b0dbc8f14791046fab8714796b6f: Status 404 returned error can't find the container with id 7b8525baa74c9d253f5310155a0bae631ae8b0dbc8f14791046fab8714796b6f Jul 07 01:30:23.298333 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:23.298224 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" event={"ID":"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b","Type":"ContainerStarted","Data":"1b7931b69f86783aa81f61ba2aaacf09ef8a2e01dfc4bd2d6e0437d210db7600"} Jul 07 01:30:23.298333 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:23.298307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" event={"ID":"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b","Type":"ContainerStarted","Data":"7b8525baa74c9d253f5310155a0bae631ae8b0dbc8f14791046fab8714796b6f"} Jul 07 01:30:23.298333 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:23.298335 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:23.316009 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:23.315959 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" podStartSLOduration=1.9023254600000001 podStartE2EDuration="2.315946193s" totalImagesPullingTime="413.620733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 01:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:30:23.315069322 +0000 UTC m=+1749.321476116" watchObservedRunningTime="2026-07-07 01:30:23.315946193 +0000 UTC m=+1749.322352975" Jul 07 01:30:26.093215 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.093182 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf"] Jul 07 01:30:26.093703 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.093423 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" podUID="7b805fdb-cb2d-4d41-8bc4-bb01493bf09b" containerName="maas-api" containerID="cri-o://1b7931b69f86783aa81f61ba2aaacf09ef8a2e01dfc4bd2d6e0437d210db7600" gracePeriod=30 Jul 07 01:30:26.314581 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.314546 2576 generic.go:356] "Generic (PLEG): container finished" podID="7b805fdb-cb2d-4d41-8bc4-bb01493bf09b" containerID="1b7931b69f86783aa81f61ba2aaacf09ef8a2e01dfc4bd2d6e0437d210db7600" exitCode=0 Jul 07 01:30:26.314736 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.314599 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" event={"ID":"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b","Type":"ContainerDied","Data":"1b7931b69f86783aa81f61ba2aaacf09ef8a2e01dfc4bd2d6e0437d210db7600"} Jul 07 01:30:26.343734 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.343678 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:26.446919 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.446883 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wq9j\" (UniqueName: \"kubernetes.io/projected/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-kube-api-access-6wq9j\") pod \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " Jul 07 01:30:26.447074 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.446993 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-maas-api-tls\") pod \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " Jul 07 01:30:26.447074 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.447041 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-openshift-service-ca\") pod \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\" (UID: \"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b\") " Jul 07 01:30:26.447449 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.447423 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7b805fdb-cb2d-4d41-8bc4-bb01493bf09b" (UID: "7b805fdb-cb2d-4d41-8bc4-bb01493bf09b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 01:30:26.449086 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.449064 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-kube-api-access-6wq9j" (OuterVolumeSpecName: "kube-api-access-6wq9j") pod "7b805fdb-cb2d-4d41-8bc4-bb01493bf09b" (UID: "7b805fdb-cb2d-4d41-8bc4-bb01493bf09b"). InnerVolumeSpecName "kube-api-access-6wq9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:30:26.449474 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.449444 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7b805fdb-cb2d-4d41-8bc4-bb01493bf09b" (UID: "7b805fdb-cb2d-4d41-8bc4-bb01493bf09b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 01:30:26.547717 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.547685 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-maas-api-tls\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:30:26.547717 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.547707 2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-openshift-service-ca\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:30:26.547717 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:26.547717 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wq9j\" (UniqueName: \"kubernetes.io/projected/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b-kube-api-access-6wq9j\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:30:27.320640 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:27.320610 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" Jul 07 01:30:27.321141 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:27.320651 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf" event={"ID":"7b805fdb-cb2d-4d41-8bc4-bb01493bf09b","Type":"ContainerDied","Data":"7b8525baa74c9d253f5310155a0bae631ae8b0dbc8f14791046fab8714796b6f"} Jul 07 01:30:27.321141 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:27.320726 2576 scope.go:117] "RemoveContainer" containerID="1b7931b69f86783aa81f61ba2aaacf09ef8a2e01dfc4bd2d6e0437d210db7600" Jul 07 01:30:27.337686 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:27.337660 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf"] Jul 07 01:30:27.339491 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:27.339474 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-5ec2bff8-5bbb45bbcd-m72cf"] Jul 07 01:30:28.548527 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:30:28.548488 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b805fdb-cb2d-4d41-8bc4-bb01493bf09b" path="/var/lib/kubelet/pods/7b805fdb-cb2d-4d41-8bc4-bb01493bf09b/volumes" Jul 07 01:44:38.192352 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:38.192224 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6567c79cc6-n2psk_65fd620f-64e1-4430-9447-aae600e11c16/authorino/0.log" Jul 07 01:44:43.063600 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:43.063567 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-cc8d47df9-zd6rt_e6d60e85-3d6e-4e89-9ce1-ccd8f976f501/maas-api/0.log" Jul 07 01:44:43.179283 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:43.179238 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723115-bqllk_731ba782-1d7a-4848-9117-655b2287a639/cleanup/0.log" Jul 07 01:44:43.407508 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:43.407475 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75dccc95f8-g52dq_696c2eb5-b1da-48b7-a0c7-b5303c5029b0/manager/0.log" Jul 07 01:44:43.940225 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:43.940193 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs_6033714e-01b8-4d4d-b8ac-1995bc700d76/copy-manifests/0.log" Jul 07 01:44:43.958663 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:43.958634 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs_6033714e-01b8-4d4d-b8ac-1995bc700d76/manager/0.log" Jul 07 01:44:44.211468 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:44.211389 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-4fqkc_dd68a3f6-5dff-486f-a424-9ff84b251d5b/postgres/0.log" Jul 07 01:44:45.551722 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:45.551691 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6567c79cc6-n2psk_65fd620f-64e1-4430-9447-aae600e11c16/authorino/0.log" Jul 07 01:44:46.153559 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:46.153533 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cm94s_a004afb1-88b2-4f11-81d0-a77d1c610e5e/manager/0.log" Jul 07 01:44:47.166414 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:47.166386 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9b59ff655-qr574_a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d/kube-auth-proxy/0.log" Jul 07 01:44:47.445483 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:47.445412 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-4zvps_ba839f97-a5b7-47d7-852b-b98e63a612d5/payload-pre-processing/0.log" Jul 07 01:44:56.356560 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:56.356514 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-68b5t_65d3c830-6ebf-4887-afe4-3ecb1691bb6d/global-pull-secret-syncer/0.log" Jul 07 01:44:56.588088 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:56.588058 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sgprq_373ac353-db46-48b9-bb11-860c69820e52/konnectivity-agent/0.log" Jul 07 01:44:56.625941 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:44:56.625868 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-147.ec2.internal_05558f760ed54fc5f15c38b24f368f0e/haproxy/0.log" Jul 07 01:45:00.148131 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:00.148100 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723145-5lbrm"] Jul 07 01:45:00.148555 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:00.148541 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b805fdb-cb2d-4d41-8bc4-bb01493bf09b" containerName="maas-api" Jul 07 01:45:00.148602 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:00.148557 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b805fdb-cb2d-4d41-8bc4-bb01493bf09b" containerName="maas-api" Jul 07 01:45:00.148637 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:00.148621 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b805fdb-cb2d-4d41-8bc4-bb01493bf09b" containerName="maas-api" Jul 07 01:45:00.151648 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:00.151633 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723145-5lbrm" Jul 07 01:45:00.167542 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:00.167509 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723145-5lbrm"] Jul 07 01:45:00.274226 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:00.274183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f92dd\" (UniqueName: \"kubernetes.io/projected/8eb928c5-550e-4026-a101-2ac6443066cc-kube-api-access-f92dd\") pod \"maas-api-key-cleanup-29723145-5lbrm\" (UID: \"8eb928c5-550e-4026-a101-2ac6443066cc\") " pod="opendatahub/maas-api-key-cleanup-29723145-5lbrm" Jul 07 01:45:00.375451 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:00.375415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f92dd\" (UniqueName: \"kubernetes.io/projected/8eb928c5-550e-4026-a101-2ac6443066cc-kube-api-access-f92dd\") pod \"maas-api-key-cleanup-29723145-5lbrm\" (UID: \"8eb928c5-550e-4026-a101-2ac6443066cc\") " pod="opendatahub/maas-api-key-cleanup-29723145-5lbrm" Jul 07 01:45:00.385129 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:00.385104 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f92dd\" (UniqueName: \"kubernetes.io/projected/8eb928c5-550e-4026-a101-2ac6443066cc-kube-api-access-f92dd\") pod \"maas-api-key-cleanup-29723145-5lbrm\" (UID: \"8eb928c5-550e-4026-a101-2ac6443066cc\") " pod="opendatahub/maas-api-key-cleanup-29723145-5lbrm" Jul 07 01:45:00.461726 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:00.461640 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723145-5lbrm" Jul 07 01:45:00.600665 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:00.599697 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723145-5lbrm"] Jul 07 01:45:00.738377 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:00.738287 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723145-5lbrm" event={"ID":"8eb928c5-550e-4026-a101-2ac6443066cc","Type":"ContainerStarted","Data":"6329e86d0b6aaa02dd9b0f493cabaf296257440b74a8a1d0c62b7b7d661530b6"} Jul 07 01:45:01.745102 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:01.745061 2576 generic.go:356] "Generic (PLEG): container finished" podID="8eb928c5-550e-4026-a101-2ac6443066cc" containerID="8d8f4b957d8eae529967f8882eb9476b44866006c668e0a7a44dcd4014279b3f" exitCode=0 Jul 07 01:45:01.745553 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:01.745140 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723145-5lbrm" event={"ID":"8eb928c5-550e-4026-a101-2ac6443066cc","Type":"ContainerDied","Data":"8d8f4b957d8eae529967f8882eb9476b44866006c668e0a7a44dcd4014279b3f"} Jul 07 01:45:01.986317 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:01.986290 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6567c79cc6-n2psk_65fd620f-64e1-4430-9447-aae600e11c16/authorino/0.log" Jul 07 01:45:02.281183 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:02.281101 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-cm94s_a004afb1-88b2-4f11-81d0-a77d1c610e5e/manager/0.log" Jul 07 01:45:02.884934 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:02.884912 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723145-5lbrm" Jul 07 01:45:03.000879 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:03.000843 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f92dd\" (UniqueName: \"kubernetes.io/projected/8eb928c5-550e-4026-a101-2ac6443066cc-kube-api-access-f92dd\") pod \"8eb928c5-550e-4026-a101-2ac6443066cc\" (UID: \"8eb928c5-550e-4026-a101-2ac6443066cc\") " Jul 07 01:45:03.003075 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:03.003045 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eb928c5-550e-4026-a101-2ac6443066cc-kube-api-access-f92dd" (OuterVolumeSpecName: "kube-api-access-f92dd") pod "8eb928c5-550e-4026-a101-2ac6443066cc" (UID: "8eb928c5-550e-4026-a101-2ac6443066cc"). InnerVolumeSpecName "kube-api-access-f92dd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 01:45:03.101744 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:03.101703 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f92dd\" (UniqueName: \"kubernetes.io/projected/8eb928c5-550e-4026-a101-2ac6443066cc-kube-api-access-f92dd\") on node \"ip-10-0-130-147.ec2.internal\" DevicePath \"\"" Jul 07 01:45:03.756097 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:03.756067 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723145-5lbrm" event={"ID":"8eb928c5-550e-4026-a101-2ac6443066cc","Type":"ContainerDied","Data":"6329e86d0b6aaa02dd9b0f493cabaf296257440b74a8a1d0c62b7b7d661530b6"} Jul 07 01:45:03.756097 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:03.756087 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723145-5lbrm" Jul 07 01:45:03.756333 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:03.756113 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6329e86d0b6aaa02dd9b0f493cabaf296257440b74a8a1d0c62b7b7d661530b6" Jul 07 01:45:04.115072 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.115047 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_714ce4b7-ffff-435e-b1b7-2749a114c166/alertmanager/0.log" Jul 07 01:45:04.154196 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.154113 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_714ce4b7-ffff-435e-b1b7-2749a114c166/config-reloader/0.log" Jul 07 01:45:04.178588 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.178563 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_714ce4b7-ffff-435e-b1b7-2749a114c166/kube-rbac-proxy-web/0.log" Jul 07 01:45:04.209153 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.209124 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_714ce4b7-ffff-435e-b1b7-2749a114c166/kube-rbac-proxy/0.log" Jul 07 01:45:04.239474 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.239443 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_714ce4b7-ffff-435e-b1b7-2749a114c166/kube-rbac-proxy-metric/0.log" Jul 07 01:45:04.281869 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.281843 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_714ce4b7-ffff-435e-b1b7-2749a114c166/prom-label-proxy/0.log" Jul 07 01:45:04.320003 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.319975 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_714ce4b7-ffff-435e-b1b7-2749a114c166/init-config-reloader/0.log" Jul 07 01:45:04.421844 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.421818 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-j6vq9_1828852c-70ef-4295-ad42-ce6ff2ef9842/kube-state-metrics/0.log" Jul 07 01:45:04.461441 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.461411 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-j6vq9_1828852c-70ef-4295-ad42-ce6ff2ef9842/kube-rbac-proxy-main/0.log" Jul 07 01:45:04.501942 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.501908 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-j6vq9_1828852c-70ef-4295-ad42-ce6ff2ef9842/kube-rbac-proxy-self/0.log" Jul 07 01:45:04.537554 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.537530 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7cd7f95c5d-td4fq_fcda3d37-4ce0-4392-afbf-a9991d665a91/metrics-server/0.log" Jul 07 01:45:04.584060 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.584036 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-klhw8_109a9497-7415-4661-b893-cefa1376342a/monitoring-plugin/0.log" Jul 07 01:45:04.625374 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.625343 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cdxl2_9731734c-7a19-42cb-9d7b-a68c13df6505/node-exporter/0.log" Jul 07 01:45:04.648933 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.648914 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cdxl2_9731734c-7a19-42cb-9d7b-a68c13df6505/kube-rbac-proxy/0.log" Jul 07 01:45:04.676669 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.676598 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cdxl2_9731734c-7a19-42cb-9d7b-a68c13df6505/init-textfile/0.log" Jul 07 01:45:04.883757 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.883722 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5cl5j_9fdf14b9-97aa-4ee6-a17a-faa4fc120060/kube-rbac-proxy-main/0.log" Jul 07 01:45:04.906907 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.906877 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5cl5j_9fdf14b9-97aa-4ee6-a17a-faa4fc120060/kube-rbac-proxy-self/0.log" Jul 07 01:45:04.926991 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.926927 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-5cl5j_9fdf14b9-97aa-4ee6-a17a-faa4fc120060/openshift-state-metrics/0.log" Jul 07 01:45:04.967647 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.967620 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c84bbca0-0a79-486a-ad5e-1c33fb2c2d19/prometheus/0.log" Jul 07 01:45:04.988947 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:04.988915 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c84bbca0-0a79-486a-ad5e-1c33fb2c2d19/config-reloader/0.log" Jul 07 01:45:05.010396 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.010368 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c84bbca0-0a79-486a-ad5e-1c33fb2c2d19/thanos-sidecar/0.log" Jul 07 01:45:05.030746 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.030721 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c84bbca0-0a79-486a-ad5e-1c33fb2c2d19/kube-rbac-proxy-web/0.log" Jul 07 01:45:05.049916 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.049893 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c84bbca0-0a79-486a-ad5e-1c33fb2c2d19/kube-rbac-proxy/0.log" Jul 07 01:45:05.069189 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.069171 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c84bbca0-0a79-486a-ad5e-1c33fb2c2d19/kube-rbac-proxy-thanos/0.log" Jul 07 01:45:05.089668 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.089644 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c84bbca0-0a79-486a-ad5e-1c33fb2c2d19/init-config-reloader/0.log" Jul 07 01:45:05.116405 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.116383 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-f9p4j_583371ff-b6da-4006-b443-09928b8f3be9/prometheus-operator/0.log" Jul 07 01:45:05.139363 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.139343 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-f9p4j_583371ff-b6da-4006-b443-09928b8f3be9/kube-rbac-proxy/0.log" Jul 07 01:45:05.169311 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.169284 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-2s2hk_a903d6c8-ca63-44d0-832c-f0a999c3ae23/prometheus-operator-admission-webhook/0.log" Jul 07 01:45:05.201957 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.201880 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5847ddc64f-wlwbh_173d1b1f-9532-4d42-99fa-1f54ce8aebd6/telemeter-client/0.log" Jul 07 01:45:05.228117 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.228091 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5847ddc64f-wlwbh_173d1b1f-9532-4d42-99fa-1f54ce8aebd6/reload/0.log" Jul 07 01:45:05.253178 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.253146 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5847ddc64f-wlwbh_173d1b1f-9532-4d42-99fa-1f54ce8aebd6/kube-rbac-proxy/0.log" Jul 07 01:45:05.289469 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.289441 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5bfc5fbf-7qz6p_6799d0af-716a-4618-b783-d6ef10fb7fd3/thanos-query/0.log" Jul 07 01:45:05.310322 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.310292 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5bfc5fbf-7qz6p_6799d0af-716a-4618-b783-d6ef10fb7fd3/kube-rbac-proxy-web/0.log" Jul 07 01:45:05.333739 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.333717 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5bfc5fbf-7qz6p_6799d0af-716a-4618-b783-d6ef10fb7fd3/kube-rbac-proxy/0.log" Jul 07 01:45:05.355519 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.355496 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5bfc5fbf-7qz6p_6799d0af-716a-4618-b783-d6ef10fb7fd3/prom-label-proxy/0.log" Jul 07 01:45:05.376980 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.376958 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5bfc5fbf-7qz6p_6799d0af-716a-4618-b783-d6ef10fb7fd3/kube-rbac-proxy-rules/0.log" Jul 07 01:45:05.397751 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:05.397727 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d5bfc5fbf-7qz6p_6799d0af-716a-4618-b783-d6ef10fb7fd3/kube-rbac-proxy-metrics/0.log" Jul 07 01:45:06.560509 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.560475 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp"] Jul 07 01:45:06.560980 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.560884 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb928c5-550e-4026-a101-2ac6443066cc" containerName="cleanup" Jul 07 01:45:06.560980 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.560895 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb928c5-550e-4026-a101-2ac6443066cc" containerName="cleanup" Jul 07 01:45:06.560980 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.560953 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb928c5-550e-4026-a101-2ac6443066cc" containerName="cleanup" Jul 07 01:45:06.565464 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.565442 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.569377 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.569354 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fhw8n\"/\"default-dockercfg-gpjhs\"" Jul 07 01:45:06.569511 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.569359 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fhw8n\"/\"openshift-service-ca.crt\"" Jul 07 01:45:06.570825 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.570804 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fhw8n\"/\"kube-root-ca.crt\"" Jul 07 01:45:06.573858 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.573839 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp"] Jul 07 01:45:06.634459 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.634424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-lib-modules\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.634459 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.634472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwngb\" (UniqueName: \"kubernetes.io/projected/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-kube-api-access-pwngb\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.634740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.634492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-proc\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.634740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.634589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-sys\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.634740 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.634653 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-podres\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.735394 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.735357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-lib-modules\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.735394 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.735401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwngb\" (UniqueName: \"kubernetes.io/projected/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-kube-api-access-pwngb\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.735648 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.735422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-proc\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.735648 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.735452 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-sys\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.735648 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.735484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-podres\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.735648 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.735522 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-proc\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.735648 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.735569 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-lib-modules\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.735648 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.735584 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-sys\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.735648 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.735598 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-podres\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.744901 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.744873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwngb\" (UniqueName: \"kubernetes.io/projected/92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4-kube-api-access-pwngb\") pod \"perf-node-gather-daemonset-xxfnp\" (UID: \"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4\") " pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:06.877441 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:06.877405 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:07.017004 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:07.016972 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp"] Jul 07 01:45:07.018812 ip-10-0-130-147 kubenswrapper[2576]: W0707 01:45:07.018785 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod92c8aef3_a4ef_49a2_ba43_0d7cc4a247a4.slice/crio-9046448a87652e2408952d52a055010a0ff8349d154e7c579b9ef1634e552f11 WatchSource:0}: Error finding container 9046448a87652e2408952d52a055010a0ff8349d154e7c579b9ef1634e552f11: Status 404 returned error can't find the container with id 9046448a87652e2408952d52a055010a0ff8349d154e7c579b9ef1634e552f11 Jul 07 01:45:07.776913 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:07.776869 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" event={"ID":"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4","Type":"ContainerStarted","Data":"7710b9befb38db361108bdfe33b52b8a9bd2cd7e672079ac8c8ca958cf908b3e"} Jul 07 01:45:07.777427 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:07.776932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" event={"ID":"92c8aef3-a4ef-49a2-ba43-0d7cc4a247a4","Type":"ContainerStarted","Data":"9046448a87652e2408952d52a055010a0ff8349d154e7c579b9ef1634e552f11"} Jul 07 01:45:07.777427 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:07.776957 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:07.802131 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:07.796656 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" podStartSLOduration=1.796636592 podStartE2EDuration="1.796636592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 01:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 01:45:07.793901809 +0000 UTC m=+2633.800308591" watchObservedRunningTime="2026-07-07 01:45:07.796636592 +0000 UTC m=+2633.803043377" Jul 07 01:45:07.821632 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:07.821604 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59b47bf766-86fx7_4e6544e2-7a10-4932-a5b3-dfd45bf52005/console/0.log" Jul 07 01:45:07.853815 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:07.853785 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-nhp9p_5fdcd7a4-b8fc-49a3-8c9a-ed42b80e4e3e/download-server/0.log" Jul 07 01:45:09.523622 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:09.523598 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kxgqw_78b894c6-9bfd-4908-ba1c-a30ab7b48170/dns/0.log" Jul 07 01:45:09.545497 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:09.545475 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kxgqw_78b894c6-9bfd-4908-ba1c-a30ab7b48170/kube-rbac-proxy/0.log" Jul 07 01:45:09.694936 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:09.694905 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-blkpr_b79f0a2e-3ce0-4c33-b0c5-f1e686483118/dns-node-resolver/0.log" Jul 07 01:45:10.268157 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:10.268124 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-65cb76c4c9-ss7cq_5dddc459-a9e8-458a-b0a4-4535cea3682d/registry/0.log" Jul 07 01:45:10.316122 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:10.316098 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r7dvk_e56f13aa-9d35-4077-b510-f68f88822098/node-ca/0.log" Jul 07 01:45:11.582511 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:11.582479 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9b59ff655-qr574_a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d/kube-auth-proxy/0.log" Jul 07 01:45:11.699148 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:11.699123 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-4zvps_ba839f97-a5b7-47d7-852b-b98e63a612d5/payload-pre-processing/0.log" Jul 07 01:45:12.473017 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:12.472994 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6js9l_2737c20b-ff94-4457-ac24-de1ed78568fb/serve-healthcheck-canary/0.log" Jul 07 01:45:13.112808 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:13.112781 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k62p5_264510a7-fd6c-48f5-9e99-555a0fd28108/kube-rbac-proxy/0.log" Jul 07 01:45:13.135347 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:13.135327 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k62p5_264510a7-fd6c-48f5-9e99-555a0fd28108/exporter/0.log" Jul 07 01:45:13.155742 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:13.155722 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k62p5_264510a7-fd6c-48f5-9e99-555a0fd28108/extractor/0.log" Jul 07 01:45:13.793125 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:13.793097 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fhw8n/perf-node-gather-daemonset-xxfnp" Jul 07 01:45:15.719234 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:15.719204 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-cc8d47df9-zd6rt_e6d60e85-3d6e-4e89-9ce1-ccd8f976f501/maas-api/0.log" Jul 07 01:45:15.739473 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:15.739446 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723115-bqllk_731ba782-1d7a-4848-9117-655b2287a639/cleanup/0.log" Jul 07 01:45:15.792172 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:15.792144 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723145-5lbrm_8eb928c5-550e-4026-a101-2ac6443066cc/cleanup/0.log" Jul 07 01:45:15.907205 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:15.907166 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75dccc95f8-g52dq_696c2eb5-b1da-48b7-a0c7-b5303c5029b0/manager/0.log" Jul 07 01:45:16.147579 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:16.147546 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs_6033714e-01b8-4d4d-b8ac-1995bc700d76/manager/0.log" Jul 07 01:45:16.171518 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:16.171488 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f9ffff4fc-tfmgs_6033714e-01b8-4d4d-b8ac-1995bc700d76/copy-manifests/0.log" Jul 07 01:45:16.266832 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:16.266800 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-4fqkc_dd68a3f6-5dff-486f-a424-9ff84b251d5b/postgres/0.log" Jul 07 01:45:17.670495 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:17.670465 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67dff76b74-7fzkv_1272039d-e3dd-4df5-9268-3b38a1c2af21/manager/0.log" Jul 07 01:45:18.039878 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:18.039800 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9b59ff655-qr574_a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d/kube-auth-proxy/0.log" Jul 07 01:45:18.141730 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:18.141704 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-4zvps_ba839f97-a5b7-47d7-852b-b98e63a612d5/payload-pre-processing/0.log" Jul 07 01:45:19.626066 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:19.626035 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9b59ff655-qr574_a42ebd9c-f46a-4211-8f7e-28cf4f1cb33d/kube-auth-proxy/0.log" Jul 07 01:45:19.724607 ip-10-0-130-147 kubenswrapper[2576]: I0707 01:45:19.724578 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-4zvps_ba839f97-a5b7-47d7-852b-b98e63a612d5/payload-pre-processing/0.log"