Jul 13 02:54:51.202510 ip-10-0-130-225 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 13 02:54:51.202521 ip-10-0-130-225 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 13 02:54:51.202536 ip-10-0-130-225 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 13 02:54:51.202825 ip-10-0-130-225 systemd[1]: Failed to start Kubernetes Kubelet. Jul 13 02:55:01.324525 ip-10-0-130-225 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 13 02:55:01.324547 ip-10-0-130-225 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c9cd3aa5b08c4502a727f335ddbc190c -- Jul 13 02:56:58.836455 ip-10-0-130-225 systemd[1]: Starting Kubernetes Kubelet... Jul 13 02:56:59.211736 ip-10-0-130-225 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 02:56:59.211736 ip-10-0-130-225 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 02:56:59.211736 ip-10-0-130-225 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 02:56:59.211736 ip-10-0-130-225 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 02:56:59.211736 ip-10-0-130-225 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 02:56:59.214021 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.213914 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 02:56:59.218742 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218709 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 02:56:59.218742 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218735 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 02:56:59.218742 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218740 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 02:56:59.218742 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218744 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 02:56:59.218742 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218749 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 02:56:59.218742 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218754 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218759 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218763 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218767 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218770 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218773 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218777 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218781 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218786 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218791 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218804 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218809 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218812 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218816 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218819 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218823 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218827 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218831 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218834 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 02:56:59.219097 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218838 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218842 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218846 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218850 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218854 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218858 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218862 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218865 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218870 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218873 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218877 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218881 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218886 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218890 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218894 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218899 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218904 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218909 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218914 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218918 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 02:56:59.219872 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218923 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218929 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218933 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218937 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218941 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218945 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218952 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218959 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218964 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218968 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218973 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218977 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218982 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218986 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218991 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218995 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.218999 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219003 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219007 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 02:56:59.220464 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219011 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219016 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219020 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219026 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219033 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219042 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219048 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219054 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219060 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219066 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219070 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219075 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219081 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219085 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219090 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219094 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219098 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219102 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219106 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219110 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 02:56:59.220935 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219115 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219119 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219123 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219128 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219132 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219154 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219159 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219164 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219168 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219172 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219177 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219181 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219184 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219188 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219193 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.219197 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220352 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220366 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220370 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 02:56:59.221494 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220373 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220377 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220380 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220383 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220386 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220388 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220391 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220393 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220396 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220399 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220401 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220405 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220408 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220411 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220413 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220416 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220418 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220421 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220424 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220427 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 02:56:59.221970 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220429 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220432 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220434 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220437 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220440 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220444 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220448 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220451 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220454 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220457 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220461 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220463 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220466 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220469 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220471 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220474 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220477 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220479 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220482 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 02:56:59.222503 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220484 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220487 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220489 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220492 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220494 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220497 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220499 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220501 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220504 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220507 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220510 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220512 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220515 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220517 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220520 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220522 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220525 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220527 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220529 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 02:56:59.222978 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220532 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220534 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220537 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220540 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220543 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220546 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220549 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220552 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220555 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220557 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220559 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220562 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220564 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220567 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220569 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220572 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220574 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220578 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220584 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220587 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 02:56:59.223472 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220590 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220593 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220596 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220599 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220602 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220605 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220607 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220610 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220612 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220615 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220617 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220622 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220626 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220629 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220632 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220634 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220637 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.220639 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221136 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221165 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 02:56:59.223972 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221169 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221172 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221175 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221178 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221181 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221184 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221187 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221189 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221192 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221195 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221197 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221200 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221203 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221205 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221208 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221211 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221214 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221216 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221219 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221221 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 02:56:59.224550 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221224 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221226 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221229 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221231 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221235 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221237 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221239 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221242 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221244 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221247 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221251 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221253 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221256 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221258 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221261 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221265 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221268 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221271 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221274 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 02:56:59.225050 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221277 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221279 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221282 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221284 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221287 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221289 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221292 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221298 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221301 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221305 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221307 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221310 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221313 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221315 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221318 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221320 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221324 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221326 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221329 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 02:56:59.225548 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221331 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221334 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221336 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221339 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221341 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221345 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221348 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221350 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221353 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221356 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221358 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221361 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221363 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221366 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221368 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221371 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221373 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221376 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221378 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221381 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 02:56:59.226044 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221383 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221386 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221388 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221391 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221396 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221400 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221403 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221406 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221408 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221411 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221414 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221417 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221419 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221422 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221424 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221427 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221429 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221432 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.221436 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221516 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 02:56:59.226596 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221525 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221532 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221536 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221541 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221545 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221549 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221553 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221556 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221559 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221563 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221566 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221569 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221573 2563 flags.go:64] FLAG: --cgroup-root="" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221576 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221579 2563 flags.go:64] FLAG: --client-ca-file="" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221582 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221585 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221590 2563 flags.go:64] FLAG: --cluster-domain="" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221593 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221596 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221599 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221603 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221606 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 02:56:59.227087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221622 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221626 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221630 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221633 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221636 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221640 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221644 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221647 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221661 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221664 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221667 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221670 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221673 2563 flags.go:64] FLAG: --enable-server="true" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221676 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221684 2563 flags.go:64] FLAG: --event-burst="100" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221688 2563 flags.go:64] FLAG: --event-qps="50" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221691 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221694 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221697 2563 flags.go:64] FLAG: --eviction-hard="" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221701 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221704 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221707 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221710 2563 flags.go:64] FLAG: --eviction-soft="" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221713 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221716 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 02:56:59.227683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221719 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221722 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221725 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221728 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221731 2563 flags.go:64] FLAG: --feature-gates="" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221735 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221738 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221741 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221744 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221747 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221750 2563 flags.go:64] FLAG: --help="false" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221753 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221756 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221759 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221762 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221765 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221774 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221777 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221780 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221783 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221787 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221790 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221793 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221796 2563 flags.go:64] FLAG: --kube-reserved="" Jul 13 02:56:59.228346 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221799 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221802 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221805 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221808 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221811 2563 flags.go:64] FLAG: --lock-file="" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221814 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221817 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221820 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221825 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221828 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221831 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221834 2563 flags.go:64] FLAG: --logging-format="text" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221837 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221840 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221843 2563 flags.go:64] FLAG: --manifest-url="" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221846 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221851 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221854 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221858 2563 flags.go:64] FLAG: --max-pods="110" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221861 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221864 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221867 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221870 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221873 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221875 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 02:56:59.228953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221884 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221893 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221896 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221899 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221902 2563 flags.go:64] FLAG: --pod-cidr="" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221909 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221916 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221919 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221922 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221925 2563 flags.go:64] FLAG: --port="10250" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221928 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221931 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-048567589622f558f" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221934 2563 flags.go:64] FLAG: --qos-reserved="" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221937 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221940 2563 flags.go:64] FLAG: --register-node="true" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221943 2563 flags.go:64] FLAG: --register-with-taints="" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221947 2563 flags.go:64] FLAG: --registry-burst="10" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221950 2563 flags.go:64] FLAG: --registry-qps="5" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221953 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221956 2563 flags.go:64] FLAG: --reserved-memory="" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221959 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221962 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221965 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221968 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221971 2563 flags.go:64] FLAG: --runonce="false" Jul 13 02:56:59.229594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221974 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221977 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221981 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221984 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221987 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221990 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221993 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221996 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.221999 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222002 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222005 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222008 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222011 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222015 2563 flags.go:64] FLAG: --system-cgroups="" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222018 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222024 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222027 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222037 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222046 2563 flags.go:64] FLAG: --tls-min-version="" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222049 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222053 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222055 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222058 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222061 2563 flags.go:64] FLAG: --v="2" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222066 2563 flags.go:64] FLAG: --version="false" Jul 13 02:56:59.230286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222070 2563 flags.go:64] FLAG: --vmodule="" Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222074 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.222078 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222228 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222233 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222237 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222240 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222242 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222245 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222248 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222251 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222254 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222258 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222262 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222264 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222267 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222278 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222281 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222284 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222287 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 02:56:59.230911 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222291 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222293 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222296 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222299 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222301 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222304 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222307 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222309 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222312 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222314 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222317 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222320 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222322 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222325 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222328 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222331 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222333 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222336 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222339 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 02:56:59.231433 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222341 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222344 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222347 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222349 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222352 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222354 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222357 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222359 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222362 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222366 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222370 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222372 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222375 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222378 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222381 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222384 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222386 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222389 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222391 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 02:56:59.231907 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222394 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222397 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222399 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222402 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222404 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222407 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222410 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222412 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222415 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222418 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222420 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222422 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222425 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222427 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222430 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222433 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222435 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222438 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222441 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 02:56:59.232413 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222443 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222448 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222451 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222456 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222459 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222462 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222465 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222470 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222473 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222477 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222479 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222482 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222485 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222488 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222490 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222493 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222496 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222498 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222501 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 02:56:59.232887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222503 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222506 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222509 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222511 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222514 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.222517 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.223205 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.230405 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.230425 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.230449 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.230459 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230531 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230543 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230547 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230550 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 02:56:59.233382 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230553 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230556 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230559 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230563 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230566 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230569 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230571 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230574 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230576 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230579 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230582 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230585 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230587 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230590 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230592 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230595 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230599 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230603 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230606 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 02:56:59.233786 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230609 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230612 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230614 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230617 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230621 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230625 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230629 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230632 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230635 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230638 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230641 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230651 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230654 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230657 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230660 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230662 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230665 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230667 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230670 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 02:56:59.234286 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230672 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230675 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230678 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230680 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230683 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230686 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230688 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230691 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230700 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230702 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230705 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230707 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230710 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230712 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230715 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230717 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230719 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230722 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230724 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 02:56:59.234775 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230728 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230731 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230733 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230735 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230738 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230741 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230752 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230755 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230757 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230760 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230762 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230765 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230767 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230770 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230772 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230775 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230778 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230780 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230783 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230785 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 02:56:59.235388 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230788 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230790 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230793 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230796 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230798 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230801 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230804 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230807 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230810 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230812 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230815 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230817 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230821 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230825 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230827 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230830 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230833 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 02:56:59.235885 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.230835 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.230841 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231043 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231050 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231053 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231056 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231059 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231062 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231064 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231067 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231070 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231072 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231075 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231079 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231083 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 13 02:56:59.236339 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231086 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231089 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231091 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231094 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231097 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231101 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231105 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231107 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231111 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231114 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231116 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231119 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231122 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231125 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231127 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231130 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231132 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231135 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231155 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231159 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 02:56:59.236711 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231169 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231172 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231174 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231177 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231179 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231182 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231184 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231188 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231191 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231195 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231198 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231200 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231203 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231206 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231208 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231211 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231213 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231216 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231218 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231221 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 02:56:59.237223 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231224 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231226 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231228 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231231 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231234 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231236 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231239 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231241 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231244 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231246 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231249 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231251 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231254 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231262 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231265 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231267 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231270 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231272 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231275 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231277 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 02:56:59.237728 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231280 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231282 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231284 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231287 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231289 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231292 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231294 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231297 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231299 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231302 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231304 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231307 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231310 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231312 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231315 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231317 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231320 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231322 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231324 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 02:56:59.238495 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231327 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 02:56:59.239232 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231330 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 02:56:59.239232 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231332 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 02:56:59.239232 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231335 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 02:56:59.239232 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231337 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 02:56:59.239232 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231340 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 02:56:59.239232 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:56:59.231342 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 02:56:59.239232 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.231352 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 02:56:59.239232 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.231499 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 02:56:59.239232 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.233751 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 02:56:59.239232 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.235033 2563 server.go:1019] "Starting client certificate rotation" Jul 13 02:56:59.239232 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.235169 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 02:56:59.239232 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.235218 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 02:56:59.239547 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.239521 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 02:56:59.242694 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.242668 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 02:56:59.254969 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.254942 2563 log.go:25] "Validated CRI v1 runtime API" Jul 13 02:56:59.257077 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.257062 2563 log.go:25] "Validated CRI v1 image API" Jul 13 02:56:59.257956 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.257937 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 02:56:59.261380 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.261356 2563 fs.go:135] Filesystem UUIDs: map[1c619835-9135-442f-81d4-e6fed34854df:/dev/nvme0n1p3 292362df-06ec-49f4-a308-5eba4a63fde8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 13 02:56:59.261431 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.261380 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 02:56:59.262025 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.262003 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 02:56:59.266852 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.266725 2563 manager.go:216] Machine: {Timestamp:2026-07-13 02:56:59.266198549 +0000 UTC m=+0.317005502 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102574 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f06178fe8d088a296a8f7e1d90c80 SystemUUID:ec2f0617-8fe8-d088-a296-a8f7e1d90c80 BootID:c9cd3aa5-b08c-4502-a727-f335ddbc190c Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a8:f4:a4:b6:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a8:f4:a4:b6:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:70:17:db:01:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 02:56:59.266852 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.266840 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 02:56:59.266981 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.266934 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 02:56:59.270098 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.270066 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 02:56:59.270286 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.270102 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-225.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 02:56:59.270845 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.270834 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 02:56:59.270881 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.270846 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 02:56:59.270881 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.270855 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 02:56:59.271581 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.271569 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 02:56:59.273030 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.273017 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 02:56:59.277036 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.277020 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 13 02:56:59.277191 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.277181 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 02:56:59.277224 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.277214 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 13 02:56:59.277252 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.277227 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 02:56:59.277252 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.277247 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 02:56:59.277317 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.277262 2563 kubelet.go:398] "Adding apiserver pod source" Jul 13 02:56:59.277317 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.277272 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 02:56:59.277832 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.277776 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 02:56:59.277900 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.277845 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 02:56:59.280084 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.280062 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 02:56:59.283040 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.283009 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 02:56:59.283167 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.283059 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 02:56:59.283311 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.283297 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 02:56:59.283366 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.283320 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 02:56:59.283366 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.283336 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 02:56:59.283366 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.283347 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 02:56:59.283366 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.283360 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 02:56:59.283502 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.283369 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 02:56:59.283967 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.283762 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 02:56:59.284031 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.283976 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 02:56:59.284031 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.283987 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 02:56:59.284031 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.283994 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 02:56:59.284031 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.284005 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 02:56:59.284031 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.284014 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 02:56:59.284723 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.284713 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 02:56:59.284723 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.284723 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 02:56:59.288170 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.288154 2563 server.go:1268] "Started kubelet" Jul 13 02:56:59.288310 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.288245 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 02:56:59.288470 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.288245 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 02:56:59.288530 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.288502 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 02:56:59.289186 ip-10-0-130-225 systemd[1]: Started Kubernetes Kubelet. Jul 13 02:56:59.289808 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.289602 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 02:56:59.290827 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.290812 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 13 02:56:59.294399 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.294377 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 02:56:59.294542 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.294380 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 02:56:59.294598 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.294532 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:56:59.294900 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.294881 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 02:56:59.294900 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.294881 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 02:56:59.294900 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.294905 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 02:56:59.295177 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.295029 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 13 02:56:59.295177 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.295036 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 13 02:56:59.295844 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.294694 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-225.ec2.internal.18c1b9fbf96e416d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-225.ec2.internal,UID:ip-10-0-130-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-225.ec2.internal,},FirstTimestamp:2026-07-13 02:56:59.288109421 +0000 UTC m=+0.338916368,LastTimestamp:2026-07-13 02:56:59.288109421 +0000 UTC m=+0.338916368,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-225.ec2.internal,}" Jul 13 02:56:59.295844 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.295697 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 02:56:59.295844 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.295779 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-225.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 02:56:59.296047 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.295960 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 02:56:59.297017 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.296875 2563 factory.go:153] Registering CRI-O factory Jul 13 02:56:59.297017 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.296914 2563 factory.go:223] Registration of the crio container factory successfully Jul 13 02:56:59.297017 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.296988 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 02:56:59.297017 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.297001 2563 factory.go:55] Registering systemd factory Jul 13 02:56:59.297017 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.297011 2563 factory.go:223] Registration of the systemd container factory successfully Jul 13 02:56:59.297240 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.297034 2563 factory.go:103] Registering Raw factory Jul 13 02:56:59.297240 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.297049 2563 manager.go:1196] Started watching for new ooms in manager Jul 13 02:56:59.297240 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.297102 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 02:56:59.298019 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.298004 2563 manager.go:349] Starting recovery of all containers Jul 13 02:56:59.307635 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.307611 2563 manager.go:354] Recovery completed Jul 13 02:56:59.313357 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.313334 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:59.314376 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.314348 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 02:56:59.314639 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.314614 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 02:56:59.315449 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.315416 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:59.315491 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.315471 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:59.315491 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.315488 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:59.316185 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.316127 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 02:56:59.316185 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.316155 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 02:56:59.316185 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.316132 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:59.316185 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.316173 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 13 02:56:59.316940 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.316921 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:59.317020 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.316956 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:59.317020 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.316973 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:59.318414 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.318398 2563 policy_none.go:49] "None policy: Start" Jul 13 02:56:59.318414 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.318416 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 02:56:59.318517 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.318428 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 02:56:59.320492 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.320477 2563 policy_none.go:47] "Start" Jul 13 02:56:59.331588 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.331502 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-225.ec2.internal.18c1b9fbfb0f779f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-225.ec2.internal,UID:ip-10-0-130-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-225.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-225.ec2.internal,},FirstTimestamp:2026-07-13 02:56:59.315451807 +0000 UTC m=+0.366258761,LastTimestamp:2026-07-13 02:56:59.315451807 +0000 UTC m=+0.366258761,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-225.ec2.internal,}" Jul 13 02:56:59.337353 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.337323 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhrvj" Jul 13 02:56:59.342014 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.341918 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-225.ec2.internal.18c1b9fbfb0fdd8d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-225.ec2.internal,UID:ip-10-0-130-225.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-225.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-225.ec2.internal,},FirstTimestamp:2026-07-13 02:56:59.315477901 +0000 UTC m=+0.366284851,LastTimestamp:2026-07-13 02:56:59.315477901 +0000 UTC m=+0.366284851,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-225.ec2.internal,}" Jul 13 02:56:59.346253 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.346227 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dhrvj" Jul 13 02:56:59.349985 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.349969 2563 manager.go:337] "Starting Device Plugin manager" Jul 13 02:56:59.350077 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.350002 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 02:56:59.350077 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.350012 2563 server.go:87] "Starting device plugin registration server" Jul 13 02:56:59.350337 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.350323 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 02:56:59.350398 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.350340 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 02:56:59.350443 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.350419 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 02:56:59.350503 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.350490 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 02:56:59.350546 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.350506 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 02:56:59.351289 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.351268 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 02:56:59.351387 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.351329 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:56:59.451337 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.451297 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:59.453578 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.452367 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:59.453578 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.452398 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:59.453578 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.452412 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:59.453578 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.452443 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.460406 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.460370 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 02:56:59.461665 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.461646 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.461665 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.461674 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-225.ec2.internal\": node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:56:59.461868 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.461820 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 02:56:59.461915 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.461882 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 02:56:59.461915 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.461906 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 02:56:59.461976 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.461948 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 02:56:59.464003 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.463982 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 02:56:59.480324 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.480288 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:56:59.562528 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.562469 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-225.ec2.internal"] Jul 13 02:56:59.562686 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.562568 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:59.563594 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.563574 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:59.563687 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.563609 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:59.563687 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.563624 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:59.566101 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.566087 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:59.566241 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.566226 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.566296 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.566263 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:59.566887 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.566869 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:59.566966 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.566899 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:59.566966 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.566870 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:59.566966 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.566928 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:59.566966 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.566938 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:59.566966 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.566910 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:59.569259 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.569242 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.569327 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.569270 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 02:56:59.570016 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.569998 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientMemory" Jul 13 02:56:59.570119 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.570026 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 02:56:59.570119 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.570055 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeHasSufficientPID" Jul 13 02:56:59.580676 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.580632 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:56:59.594004 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.593977 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-225.ec2.internal\" not found" node="ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.595393 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.595373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71a205fe70f937e6cd223dd5a6fc736b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-225.ec2.internal\" (UID: \"71a205fe70f937e6cd223dd5a6fc736b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.595491 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.595400 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0adb729e031a71e9be839c4552844512-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal\" (UID: \"0adb729e031a71e9be839c4552844512\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.595491 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.595417 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0adb729e031a71e9be839c4552844512-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal\" (UID: \"0adb729e031a71e9be839c4552844512\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.598596 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.598577 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-225.ec2.internal\" not found" node="ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.681588 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.681543 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:56:59.696342 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.696311 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71a205fe70f937e6cd223dd5a6fc736b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-225.ec2.internal\" (UID: \"71a205fe70f937e6cd223dd5a6fc736b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.696426 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.696346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0adb729e031a71e9be839c4552844512-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal\" (UID: \"0adb729e031a71e9be839c4552844512\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.696426 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.696362 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0adb729e031a71e9be839c4552844512-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal\" (UID: \"0adb729e031a71e9be839c4552844512\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.696426 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.696401 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/71a205fe70f937e6cd223dd5a6fc736b-config\") pod \"kube-apiserver-proxy-ip-10-0-130-225.ec2.internal\" (UID: \"71a205fe70f937e6cd223dd5a6fc736b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.696535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.696429 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0adb729e031a71e9be839c4552844512-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal\" (UID: \"0adb729e031a71e9be839c4552844512\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.696535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.696405 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0adb729e031a71e9be839c4552844512-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal\" (UID: \"0adb729e031a71e9be839c4552844512\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.782359 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.782284 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:56:59.882747 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.882720 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:56:59.896066 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.896045 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.901591 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:56:59.901457 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-225.ec2.internal" Jul 13 02:56:59.985636 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:56:59.985584 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:57:00.086439 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:00.086356 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:57:00.187407 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:00.187358 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:57:00.234822 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.234780 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 02:57:00.235528 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.234959 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 02:57:00.287745 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:00.287705 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:57:00.350111 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.350018 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 02:51:59 +0000 UTC" deadline="2028-04-24 20:35:30.76316516 +0000 UTC" Jul 13 02:57:00.350111 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.350049 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15641h38m30.413119186s" Jul 13 02:57:00.388650 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:00.388609 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-225.ec2.internal\" not found" Jul 13 02:57:00.444119 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:57:00.444073 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0adb729e031a71e9be839c4552844512.slice/crio-1e7fd96d7c9a7e3acc7d00d2c6c03e5302ce3525f1dd08f47b131948e805d3b6 WatchSource:0}: Error finding container 1e7fd96d7c9a7e3acc7d00d2c6c03e5302ce3525f1dd08f47b131948e805d3b6: Status 404 returned error can't find the container with id 1e7fd96d7c9a7e3acc7d00d2c6c03e5302ce3525f1dd08f47b131948e805d3b6 Jul 13 02:57:00.449777 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.449756 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 02:57:00.455137 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:57:00.455107 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a205fe70f937e6cd223dd5a6fc736b.slice/crio-a6f81540961a904102ebe2697f43bf1b64fcc631351ce63521365b974737c959 WatchSource:0}: Error finding container a6f81540961a904102ebe2697f43bf1b64fcc631351ce63521365b974737c959: Status 404 returned error can't find the container with id a6f81540961a904102ebe2697f43bf1b64fcc631351ce63521365b974737c959 Jul 13 02:57:00.465581 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.465527 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-225.ec2.internal" event={"ID":"71a205fe70f937e6cd223dd5a6fc736b","Type":"ContainerStarted","Data":"a6f81540961a904102ebe2697f43bf1b64fcc631351ce63521365b974737c959"} Jul 13 02:57:00.467489 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.467461 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" event={"ID":"0adb729e031a71e9be839c4552844512","Type":"ContainerStarted","Data":"1e7fd96d7c9a7e3acc7d00d2c6c03e5302ce3525f1dd08f47b131948e805d3b6"} Jul 13 02:57:00.474787 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.474762 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 02:57:00.495161 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.495124 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" Jul 13 02:57:00.507931 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.507879 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 02:57:00.510014 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.509984 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 02:57:00.511355 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.511337 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-225.ec2.internal" Jul 13 02:57:00.523895 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.523866 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 02:57:00.526383 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:00.526363 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 02:57:01.279232 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.279186 2563 apiserver.go:52] "Watching apiserver" Jul 13 02:57:01.286829 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.286797 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 02:57:01.287272 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.287236 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-nk7sp","kube-system/global-pull-secret-syncer-mjztv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk","openshift-cluster-node-tuning-operator/tuned-t6jd7","openshift-network-diagnostics/network-check-target-8p9nm","openshift-network-operator/iptables-alerter-fpjkd","openshift-ovn-kubernetes/ovnkube-node-p2jhl","kube-system/konnectivity-agent-n5xv8","kube-system/kube-apiserver-proxy-ip-10-0-130-225.ec2.internal","openshift-dns/node-resolver-8cqcw","openshift-image-registry/node-ca-pqxkj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal","openshift-multus/multus-additional-cni-plugins-2n6mg","openshift-multus/multus-jv6rr"] Jul 13 02:57:01.290065 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.290040 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8cqcw" Jul 13 02:57:01.292660 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.292628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.293303 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.293267 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 02:57:01.293567 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.293547 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 02:57:01.293728 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.293578 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kjln6\"" Jul 13 02:57:01.297197 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.294994 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.297197 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.295101 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 02:57:01.297197 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.295602 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 02:57:01.297197 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.295637 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 02:57:01.297197 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.295780 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 02:57:01.297197 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.295890 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 02:57:01.297197 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.295941 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 02:57:01.297197 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.296043 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4zdpb\"" Jul 13 02:57:01.297560 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.297457 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.298467 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.298442 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 02:57:01.298606 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.298448 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 02:57:01.298695 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.298677 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 02:57:01.299873 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.299852 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-llz4s\"" Jul 13 02:57:01.300600 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.300571 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 02:57:01.300600 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.300587 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:01.300756 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:01.300652 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:01.300926 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.300903 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v2j4p\"" Jul 13 02:57:01.301013 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.300952 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 02:57:01.302849 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.302826 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fpjkd" Jul 13 02:57:01.305512 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.305261 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.306127 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f75dab3f-51d7-44b4-98fc-b85d6dda202d-cnibin\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.306209 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306138 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f75dab3f-51d7-44b4-98fc-b85d6dda202d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.306209 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-etc-selinux\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.306209 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7359c1d2-d166-472c-b46e-c1ed274b850f-hosts-file\") pod \"node-resolver-8cqcw\" (UID: \"7359c1d2-d166-472c-b46e-c1ed274b850f\") " pod="openshift-dns/node-resolver-8cqcw" Jul 13 02:57:01.306351 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306232 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7359c1d2-d166-472c-b46e-c1ed274b850f-tmp-dir\") pod \"node-resolver-8cqcw\" (UID: \"7359c1d2-d166-472c-b46e-c1ed274b850f\") " pod="openshift-dns/node-resolver-8cqcw" Jul 13 02:57:01.306351 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f75dab3f-51d7-44b4-98fc-b85d6dda202d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.306351 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-sysctl-d\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.306351 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-systemd\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.306351 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306343 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-lib-modules\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.306534 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306361 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f75dab3f-51d7-44b4-98fc-b85d6dda202d-os-release\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.306534 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.306534 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306398 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-sys-fs\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.306534 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306422 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-kubernetes\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.306534 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306458 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-run\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.306534 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f75dab3f-51d7-44b4-98fc-b85d6dda202d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.306534 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh5v7\" (UniqueName: \"kubernetes.io/projected/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-kube-api-access-sh5v7\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.306788 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-host\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.306788 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306592 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/726a10d4-49e8-42a5-a54c-000a1af43746-etc-tuned\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.306788 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngpmh\" (UniqueName: \"kubernetes.io/projected/726a10d4-49e8-42a5-a54c-000a1af43746-kube-api-access-ngpmh\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.306788 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306646 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f75dab3f-51d7-44b4-98fc-b85d6dda202d-cni-binary-copy\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.306788 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306686 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-socket-dir\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.306788 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-registration-dir\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.306788 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-device-dir\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.307011 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-sysctl-conf\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.307011 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-sys\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.307011 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306837 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrpf6\" (UniqueName: \"kubernetes.io/projected/f75dab3f-51d7-44b4-98fc-b85d6dda202d-kube-api-access-jrpf6\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.307011 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306855 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f75dab3f-51d7-44b4-98fc-b85d6dda202d-system-cni-dir\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.307011 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-sysconfig\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.307011 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-var-lib-kubelet\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.307011 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/726a10d4-49e8-42a5-a54c-000a1af43746-tmp\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.307011 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-modprobe-d\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.307011 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.306971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfcjf\" (UniqueName: \"kubernetes.io/projected/7359c1d2-d166-472c-b46e-c1ed274b850f-kube-api-access-gfcjf\") pod \"node-resolver-8cqcw\" (UID: \"7359c1d2-d166-472c-b46e-c1ed274b850f\") " pod="openshift-dns/node-resolver-8cqcw" Jul 13 02:57:01.307487 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.307380 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 02:57:01.307487 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.307404 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 02:57:01.307487 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.307446 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xn85p\"" Jul 13 02:57:01.307643 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.307381 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 02:57:01.308087 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.308067 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n5xv8" Jul 13 02:57:01.309234 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.308921 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 02:57:01.309408 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.309386 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qkqbj\"" Jul 13 02:57:01.311341 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.311319 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pqxkj" Jul 13 02:57:01.316580 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.312485 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 02:57:01.316580 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.312901 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fx2tx\"" Jul 13 02:57:01.316580 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.314126 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 02:57:01.316580 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.314648 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:01.316580 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:01.314733 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:01.316580 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.316076 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bqzp9\"" Jul 13 02:57:01.316580 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.316236 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 02:57:01.316580 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.316296 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 02:57:01.316580 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.316369 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 02:57:01.318177 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.317446 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:01.318177 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:01.317544 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:01.318691 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.318662 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 02:57:01.320561 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.320494 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.336060 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.336029 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 02:57:01.336360 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.336335 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 02:57:01.336472 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.336453 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 02:57:01.336572 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.336529 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 02:57:01.336787 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.336763 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 02:57:01.336897 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.336821 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 02:57:01.336953 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.336894 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fgtkk\"" Jul 13 02:57:01.380701 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.380658 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lqgkw" Jul 13 02:57:01.393047 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.392996 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lqgkw" Jul 13 02:57:01.396658 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.396633 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 02:57:01.407617 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-host\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.407792 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/726a10d4-49e8-42a5-a54c-000a1af43746-etc-tuned\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.407792 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc339015-ab80-470e-b028-fbfe7dfe72de-cni-binary-copy\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.407792 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-hostroot\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.407792 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407700 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d-serviceca\") pod \"node-ca-pqxkj\" (UID: \"d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d\") " pod="openshift-image-registry/node-ca-pqxkj" Jul 13 02:57:01.407792 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407701 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-host\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.407792 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-socket-dir\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.407792 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-registration-dir\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-device-dir\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-sysctl-conf\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407865 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-socket-dir\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407874 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-multus-conf-dir\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407880 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-registration-dir\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa509e31-3c30-48b7-9f01-7f09f51229c6-konnectivity-ca\") pod \"konnectivity-agent-n5xv8\" (UID: \"aa509e31-3c30-48b7-9f01-7f09f51229c6\") " pod="kube-system/konnectivity-agent-n5xv8" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407927 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-device-dir\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407964 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/061e47b1-79f8-4431-8569-de9d25e36495-kubelet-config\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.407992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrpf6\" (UniqueName: \"kubernetes.io/projected/f75dab3f-51d7-44b4-98fc-b85d6dda202d-kube-api-access-jrpf6\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408009 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-sysctl-conf\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f75dab3f-51d7-44b4-98fc-b85d6dda202d-system-cni-dir\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-var-lib-kubelet\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-multus-socket-dir-parent\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-run-k8s-cni-cncf-io\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408081 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e4688ca-bcc1-49d5-8da8-cc55d785be32-host-slash\") pod \"iptables-alerter-fpjkd\" (UID: \"5e4688ca-bcc1-49d5-8da8-cc55d785be32\") " pod="openshift-network-operator/iptables-alerter-fpjkd" Jul 13 02:57:01.408172 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408121 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j576\" (UniqueName: \"kubernetes.io/projected/5e4688ca-bcc1-49d5-8da8-cc55d785be32-kube-api-access-7j576\") pod \"iptables-alerter-fpjkd\" (UID: \"5e4688ca-bcc1-49d5-8da8-cc55d785be32\") " pod="openshift-network-operator/iptables-alerter-fpjkd" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408169 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f75dab3f-51d7-44b4-98fc-b85d6dda202d-system-cni-dir\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408183 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-var-lib-kubelet\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408151 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-modprobe-d\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e53a37ee-b063-4f68-9740-4cb2d845ee58-ovnkube-script-lib\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408284 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfjkn\" (UniqueName: \"kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn\") pod \"network-check-target-8p9nm\" (UID: \"1e789a2a-0bb1-4e7e-987a-74712da0a3c1\") " pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408347 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5e4688ca-bcc1-49d5-8da8-cc55d785be32-iptables-alerter-script\") pod \"iptables-alerter-fpjkd\" (UID: \"5e4688ca-bcc1-49d5-8da8-cc55d785be32\") " pod="openshift-network-operator/iptables-alerter-fpjkd" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408364 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-modprobe-d\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408427 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408479 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f75dab3f-51d7-44b4-98fc-b85d6dda202d-cnibin\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408504 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-etc-openvswitch\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-system-cni-dir\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408543 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f75dab3f-51d7-44b4-98fc-b85d6dda202d-cnibin\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-os-release\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggptm\" (UniqueName: \"kubernetes.io/projected/03bd910c-0e0d-4afd-882a-9510de44edfd-kube-api-access-ggptm\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408653 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7359c1d2-d166-472c-b46e-c1ed274b850f-hosts-file\") pod \"node-resolver-8cqcw\" (UID: \"7359c1d2-d166-472c-b46e-c1ed274b850f\") " pod="openshift-dns/node-resolver-8cqcw" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408677 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7359c1d2-d166-472c-b46e-c1ed274b850f-tmp-dir\") pod \"node-resolver-8cqcw\" (UID: \"7359c1d2-d166-472c-b46e-c1ed274b850f\") " pod="openshift-dns/node-resolver-8cqcw" Jul 13 02:57:01.409008 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f75dab3f-51d7-44b4-98fc-b85d6dda202d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408772 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7359c1d2-d166-472c-b46e-c1ed274b850f-hosts-file\") pod \"node-resolver-8cqcw\" (UID: \"7359c1d2-d166-472c-b46e-c1ed274b850f\") " pod="openshift-dns/node-resolver-8cqcw" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408831 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-sysctl-d\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408868 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-systemd\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408892 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-lib-modules\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-run-ovn-kubernetes\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408943 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f75dab3f-51d7-44b4-98fc-b85d6dda202d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-multus-cni-dir\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408971 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7359c1d2-d166-472c-b46e-c1ed274b850f-tmp-dir\") pod \"node-resolver-8cqcw\" (UID: \"7359c1d2-d166-472c-b46e-c1ed274b850f\") " pod="openshift-dns/node-resolver-8cqcw" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.408988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f75dab3f-51d7-44b4-98fc-b85d6dda202d-os-release\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409045 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-systemd\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409051 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cc339015-ab80-470e-b028-fbfe7dfe72de-multus-daemon-config\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409065 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-sysctl-d\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409057 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f75dab3f-51d7-44b4-98fc-b85d6dda202d-os-release\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409092 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-etc-kubernetes\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409135 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-lib-modules\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409158 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxpw5\" (UniqueName: \"kubernetes.io/projected/cc339015-ab80-470e-b028-fbfe7dfe72de-kube-api-access-xxpw5\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.409949 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409189 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz2xw\" (UniqueName: \"kubernetes.io/projected/e53a37ee-b063-4f68-9740-4cb2d845ee58-kube-api-access-jz2xw\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409239 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f75dab3f-51d7-44b4-98fc-b85d6dda202d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh5v7\" (UniqueName: \"kubernetes.io/projected/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-kube-api-access-sh5v7\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngpmh\" (UniqueName: \"kubernetes.io/projected/726a10d4-49e8-42a5-a54c-000a1af43746-kube-api-access-ngpmh\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409322 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f75dab3f-51d7-44b4-98fc-b85d6dda202d-cni-binary-copy\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-sys\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-run-netns\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409431 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e53a37ee-b063-4f68-9740-4cb2d845ee58-ovnkube-config\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409454 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d-host\") pod \"node-ca-pqxkj\" (UID: \"d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d\") " pod="openshift-image-registry/node-ca-pqxkj" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409479 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-sysconfig\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409515 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/726a10d4-49e8-42a5-a54c-000a1af43746-tmp\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-var-lib-openvswitch\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409585 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-run-openvswitch\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-run-netns\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-kubelet\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409634 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-slash\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.410628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-node-log\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-log-socket\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfcjf\" (UniqueName: \"kubernetes.io/projected/7359c1d2-d166-472c-b46e-c1ed274b850f-kube-api-access-gfcjf\") pod \"node-resolver-8cqcw\" (UID: \"7359c1d2-d166-472c-b46e-c1ed274b850f\") " pod="openshift-dns/node-resolver-8cqcw" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409712 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f75dab3f-51d7-44b4-98fc-b85d6dda202d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-etc-selinux\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409746 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-systemd-units\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-run-systemd\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409789 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-var-lib-kubelet\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409806 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-run-ovn\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-cni-netd\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409821 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f75dab3f-51d7-44b4-98fc-b85d6dda202d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409838 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e53a37ee-b063-4f68-9740-4cb2d845ee58-env-overrides\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e53a37ee-b063-4f68-9740-4cb2d845ee58-ovn-node-metrics-cert\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409873 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-var-lib-cni-multus\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-run-multus-certs\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409944 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcjsb\" (UniqueName: \"kubernetes.io/projected/d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d-kube-api-access-mcjsb\") pod \"node-ca-pqxkj\" (UID: \"d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d\") " pod="openshift-image-registry/node-ca-pqxkj" Jul 13 02:57:01.411703 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.409970 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410032 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-sys-fs\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-kubernetes\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410088 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-run\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410113 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-cni-bin\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410142 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-cnibin\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-var-lib-cni-bin\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410287 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-sysconfig\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410312 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-etc-selinux\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410326 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f75dab3f-51d7-44b4-98fc-b85d6dda202d-cni-binary-copy\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa509e31-3c30-48b7-9f01-7f09f51229c6-agent-certs\") pod \"konnectivity-agent-n5xv8\" (UID: \"aa509e31-3c30-48b7-9f01-7f09f51229c6\") " pod="kube-system/konnectivity-agent-n5xv8" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410397 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-sys\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410443 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f75dab3f-51d7-44b4-98fc-b85d6dda202d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410447 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/061e47b1-79f8-4431-8569-de9d25e36495-dbus\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410503 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410549 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-etc-kubernetes\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.412535 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410564 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-sys-fs\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.413498 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.410605 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/726a10d4-49e8-42a5-a54c-000a1af43746-run\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.413498 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.412540 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/726a10d4-49e8-42a5-a54c-000a1af43746-etc-tuned\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.415120 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.415089 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/726a10d4-49e8-42a5-a54c-000a1af43746-tmp\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.419889 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.418727 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrpf6\" (UniqueName: \"kubernetes.io/projected/f75dab3f-51d7-44b4-98fc-b85d6dda202d-kube-api-access-jrpf6\") pod \"multus-additional-cni-plugins-2n6mg\" (UID: \"f75dab3f-51d7-44b4-98fc-b85d6dda202d\") " pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.419889 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.418921 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfcjf\" (UniqueName: \"kubernetes.io/projected/7359c1d2-d166-472c-b46e-c1ed274b850f-kube-api-access-gfcjf\") pod \"node-resolver-8cqcw\" (UID: \"7359c1d2-d166-472c-b46e-c1ed274b850f\") " pod="openshift-dns/node-resolver-8cqcw" Jul 13 02:57:01.419889 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.419554 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh5v7\" (UniqueName: \"kubernetes.io/projected/c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c-kube-api-access-sh5v7\") pod \"aws-ebs-csi-driver-node-cq8pk\" (UID: \"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.420212 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.420095 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngpmh\" (UniqueName: \"kubernetes.io/projected/726a10d4-49e8-42a5-a54c-000a1af43746-kube-api-access-ngpmh\") pod \"tuned-t6jd7\" (UID: \"726a10d4-49e8-42a5-a54c-000a1af43746\") " pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.499548 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.499516 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 02:57:01.510818 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.510778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-run-netns\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.510818 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.510828 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e53a37ee-b063-4f68-9740-4cb2d845ee58-ovnkube-config\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.510846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d-host\") pod \"node-ca-pqxkj\" (UID: \"d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d\") " pod="openshift-image-registry/node-ca-pqxkj" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.510873 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-var-lib-openvswitch\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.510900 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-run-openvswitch\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.510924 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-run-netns\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.510925 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-run-netns\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.510949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-kubelet\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.510925 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d-host\") pod \"node-ca-pqxkj\" (UID: \"d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d\") " pod="openshift-image-registry/node-ca-pqxkj" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.510965 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-var-lib-openvswitch\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.510972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-slash\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511009 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-slash\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511019 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-run-openvswitch\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511011 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-run-netns\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511025 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-kubelet\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511024 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-node-log\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511082 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511078 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-log-socket\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511067 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-node-log\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-systemd-units\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511131 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-systemd-units\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511132 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-log-socket\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511173 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-run-systemd\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511216 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-var-lib-kubelet\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511187 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-run-systemd\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-run-ovn\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-cni-netd\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511287 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-var-lib-kubelet\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e53a37ee-b063-4f68-9740-4cb2d845ee58-env-overrides\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511302 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-run-ovn\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511329 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e53a37ee-b063-4f68-9740-4cb2d845ee58-ovn-node-metrics-cert\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511345 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-cni-netd\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-var-lib-cni-multus\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-run-multus-certs\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511409 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcjsb\" (UniqueName: \"kubernetes.io/projected/d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d-kube-api-access-mcjsb\") pod \"node-ca-pqxkj\" (UID: \"d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d\") " pod="openshift-image-registry/node-ca-pqxkj" Jul 13 02:57:01.511747 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511423 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-var-lib-cni-multus\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511469 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-run-multus-certs\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:01.511513 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511545 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-cni-bin\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511581 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e53a37ee-b063-4f68-9740-4cb2d845ee58-ovnkube-config\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511613 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-cni-bin\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:01.511624 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs podName:03bd910c-0e0d-4afd-882a-9510de44edfd nodeName:}" failed. No retries permitted until 2026-07-13 02:57:02.011566491 +0000 UTC m=+3.062373431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs") pod "network-metrics-daemon-nk7sp" (UID: "03bd910c-0e0d-4afd-882a-9510de44edfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511657 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-cnibin\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511684 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-var-lib-cni-bin\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511710 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa509e31-3c30-48b7-9f01-7f09f51229c6-agent-certs\") pod \"konnectivity-agent-n5xv8\" (UID: \"aa509e31-3c30-48b7-9f01-7f09f51229c6\") " pod="kube-system/konnectivity-agent-n5xv8" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/061e47b1-79f8-4431-8569-de9d25e36495-dbus\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511735 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-var-lib-cni-bin\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511745 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-cnibin\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc339015-ab80-470e-b028-fbfe7dfe72de-cni-binary-copy\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511789 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e53a37ee-b063-4f68-9740-4cb2d845ee58-env-overrides\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511809 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-hostroot\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511829 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d-serviceca\") pod \"node-ca-pqxkj\" (UID: \"d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d\") " pod="openshift-image-registry/node-ca-pqxkj" Jul 13 02:57:01.512842 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-multus-conf-dir\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa509e31-3c30-48b7-9f01-7f09f51229c6-konnectivity-ca\") pod \"konnectivity-agent-n5xv8\" (UID: \"aa509e31-3c30-48b7-9f01-7f09f51229c6\") " pod="kube-system/konnectivity-agent-n5xv8" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511898 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-hostroot\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511900 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/061e47b1-79f8-4431-8569-de9d25e36495-kubelet-config\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511946 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/061e47b1-79f8-4431-8569-de9d25e36495-kubelet-config\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511942 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-multus-socket-dir-parent\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511964 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/061e47b1-79f8-4431-8569-de9d25e36495-dbus\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.511992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-run-k8s-cni-cncf-io\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512014 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-multus-conf-dir\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512035 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-host-run-k8s-cni-cncf-io\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e4688ca-bcc1-49d5-8da8-cc55d785be32-host-slash\") pod \"iptables-alerter-fpjkd\" (UID: \"5e4688ca-bcc1-49d5-8da8-cc55d785be32\") " pod="openshift-network-operator/iptables-alerter-fpjkd" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512068 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-multus-socket-dir-parent\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j576\" (UniqueName: \"kubernetes.io/projected/5e4688ca-bcc1-49d5-8da8-cc55d785be32-kube-api-access-7j576\") pod \"iptables-alerter-fpjkd\" (UID: \"5e4688ca-bcc1-49d5-8da8-cc55d785be32\") " pod="openshift-network-operator/iptables-alerter-fpjkd" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512115 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e4688ca-bcc1-49d5-8da8-cc55d785be32-host-slash\") pod \"iptables-alerter-fpjkd\" (UID: \"5e4688ca-bcc1-49d5-8da8-cc55d785be32\") " pod="openshift-network-operator/iptables-alerter-fpjkd" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e53a37ee-b063-4f68-9740-4cb2d845ee58-ovnkube-script-lib\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjkn\" (UniqueName: \"kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn\") pod \"network-check-target-8p9nm\" (UID: \"1e789a2a-0bb1-4e7e-987a-74712da0a3c1\") " pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512179 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5e4688ca-bcc1-49d5-8da8-cc55d785be32-iptables-alerter-script\") pod \"iptables-alerter-fpjkd\" (UID: \"5e4688ca-bcc1-49d5-8da8-cc55d785be32\") " pod="openshift-network-operator/iptables-alerter-fpjkd" Jul 13 02:57:01.513764 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-etc-openvswitch\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-system-cni-dir\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512312 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-os-release\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512338 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggptm\" (UniqueName: \"kubernetes.io/projected/03bd910c-0e0d-4afd-882a-9510de44edfd-kube-api-access-ggptm\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-run-ovn-kubernetes\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512390 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d-serviceca\") pod \"node-ca-pqxkj\" (UID: \"d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d\") " pod="openshift-image-registry/node-ca-pqxkj" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512405 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc339015-ab80-470e-b028-fbfe7dfe72de-cni-binary-copy\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512397 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-multus-cni-dir\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cc339015-ab80-470e-b028-fbfe7dfe72de-multus-daemon-config\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-etc-kubernetes\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxpw5\" (UniqueName: \"kubernetes.io/projected/cc339015-ab80-470e-b028-fbfe7dfe72de-kube-api-access-xxpw5\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:01.512498 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512512 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa509e31-3c30-48b7-9f01-7f09f51229c6-konnectivity-ca\") pod \"konnectivity-agent-n5xv8\" (UID: \"aa509e31-3c30-48b7-9f01-7f09f51229c6\") " pod="kube-system/konnectivity-agent-n5xv8" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz2xw\" (UniqueName: \"kubernetes.io/projected/e53a37ee-b063-4f68-9740-4cb2d845ee58-kube-api-access-jz2xw\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:01.512558 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret podName:061e47b1-79f8-4431-8569-de9d25e36495 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:02.012535874 +0000 UTC m=+3.063342814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret") pod "global-pull-secret-syncer-mjztv" (UID: "061e47b1-79f8-4431-8569-de9d25e36495") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512498 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-system-cni-dir\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.514595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512576 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-os-release\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.515196 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512621 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.515196 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512694 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.515196 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512707 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-host-run-ovn-kubernetes\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.515196 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512753 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-etc-kubernetes\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.515196 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512777 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc339015-ab80-470e-b028-fbfe7dfe72de-multus-cni-dir\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.515196 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.512809 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e53a37ee-b063-4f68-9740-4cb2d845ee58-etc-openvswitch\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.515196 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.513119 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e53a37ee-b063-4f68-9740-4cb2d845ee58-ovnkube-script-lib\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.515196 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.513252 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cc339015-ab80-470e-b028-fbfe7dfe72de-multus-daemon-config\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.515196 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.513395 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5e4688ca-bcc1-49d5-8da8-cc55d785be32-iptables-alerter-script\") pod \"iptables-alerter-fpjkd\" (UID: \"5e4688ca-bcc1-49d5-8da8-cc55d785be32\") " pod="openshift-network-operator/iptables-alerter-fpjkd" Jul 13 02:57:01.515196 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.514522 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e53a37ee-b063-4f68-9740-4cb2d845ee58-ovn-node-metrics-cert\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.515196 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.514892 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa509e31-3c30-48b7-9f01-7f09f51229c6-agent-certs\") pod \"konnectivity-agent-n5xv8\" (UID: \"aa509e31-3c30-48b7-9f01-7f09f51229c6\") " pod="kube-system/konnectivity-agent-n5xv8" Jul 13 02:57:01.522636 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:01.522526 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:01.522636 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:01.522562 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:01.522636 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:01.522578 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wfjkn for pod openshift-network-diagnostics/network-check-target-8p9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:01.522930 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:01.522733 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn podName:1e789a2a-0bb1-4e7e-987a-74712da0a3c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:02.02270947 +0000 UTC m=+3.073516412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wfjkn" (UniqueName: "kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn") pod "network-check-target-8p9nm" (UID: "1e789a2a-0bb1-4e7e-987a-74712da0a3c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:01.525060 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.525029 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcjsb\" (UniqueName: \"kubernetes.io/projected/d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d-kube-api-access-mcjsb\") pod \"node-ca-pqxkj\" (UID: \"d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d\") " pod="openshift-image-registry/node-ca-pqxkj" Jul 13 02:57:01.525190 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.525029 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j576\" (UniqueName: \"kubernetes.io/projected/5e4688ca-bcc1-49d5-8da8-cc55d785be32-kube-api-access-7j576\") pod \"iptables-alerter-fpjkd\" (UID: \"5e4688ca-bcc1-49d5-8da8-cc55d785be32\") " pod="openshift-network-operator/iptables-alerter-fpjkd" Jul 13 02:57:01.525190 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.525180 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz2xw\" (UniqueName: \"kubernetes.io/projected/e53a37ee-b063-4f68-9740-4cb2d845ee58-kube-api-access-jz2xw\") pod \"ovnkube-node-p2jhl\" (UID: \"e53a37ee-b063-4f68-9740-4cb2d845ee58\") " pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:01.525312 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.525266 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxpw5\" (UniqueName: \"kubernetes.io/projected/cc339015-ab80-470e-b028-fbfe7dfe72de-kube-api-access-xxpw5\") pod \"multus-jv6rr\" (UID: \"cc339015-ab80-470e-b028-fbfe7dfe72de\") " pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.526490 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.526468 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggptm\" (UniqueName: \"kubernetes.io/projected/03bd910c-0e0d-4afd-882a-9510de44edfd-kube-api-access-ggptm\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:01.611727 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.611627 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8cqcw" Jul 13 02:57:01.625413 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.625381 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2n6mg" Jul 13 02:57:01.636602 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.636565 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" Jul 13 02:57:01.642784 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.642751 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" Jul 13 02:57:01.651993 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.651960 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fpjkd" Jul 13 02:57:01.676412 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.676364 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jv6rr" Jul 13 02:57:01.686976 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.686938 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-n5xv8" Jul 13 02:57:01.693162 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.693129 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pqxkj" Jul 13 02:57:01.701635 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:01.701604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:02.017877 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:02.017773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:02.017877 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:02.017848 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:02.018093 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:02.017946 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:02.018093 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:02.018013 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret podName:061e47b1-79f8-4431-8569-de9d25e36495 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:03.017996994 +0000 UTC m=+4.068803932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret") pod "global-pull-secret-syncer-mjztv" (UID: "061e47b1-79f8-4431-8569-de9d25e36495") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:02.018093 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:02.017946 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:02.018093 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:02.018077 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs podName:03bd910c-0e0d-4afd-882a-9510de44edfd nodeName:}" failed. No retries permitted until 2026-07-13 02:57:03.018064023 +0000 UTC m=+4.068870959 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs") pod "network-metrics-daemon-nk7sp" (UID: "03bd910c-0e0d-4afd-882a-9510de44edfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:02.118627 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:02.118577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjkn\" (UniqueName: \"kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn\") pod \"network-check-target-8p9nm\" (UID: \"1e789a2a-0bb1-4e7e-987a-74712da0a3c1\") " pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:02.118787 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:02.118764 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:02.118826 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:02.118793 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:02.118826 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:02.118804 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wfjkn for pod openshift-network-diagnostics/network-check-target-8p9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:02.118908 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:02.118864 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn podName:1e789a2a-0bb1-4e7e-987a-74712da0a3c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:03.118847709 +0000 UTC m=+4.169654646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wfjkn" (UniqueName: "kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn") pod "network-check-target-8p9nm" (UID: "1e789a2a-0bb1-4e7e-987a-74712da0a3c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:02.396126 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:02.396013 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 02:52:01 +0000 UTC" deadline="2028-03-27 18:50:22.77468683 +0000 UTC" Jul 13 02:57:02.396126 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:02.396064 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14967h53m20.378627066s" Jul 13 02:57:02.463250 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:02.463209 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:02.463430 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:02.463207 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:02.463430 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:02.463379 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:02.463564 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:02.463468 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:02.496990 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:57:02.496953 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726a10d4_49e8_42a5_a54c_000a1af43746.slice/crio-aaa3313eddc7472ff3ab6644393bfe808cbd907d12c352e337692757084bc36b WatchSource:0}: Error finding container aaa3313eddc7472ff3ab6644393bfe808cbd907d12c352e337692757084bc36b: Status 404 returned error can't find the container with id aaa3313eddc7472ff3ab6644393bfe808cbd907d12c352e337692757084bc36b Jul 13 02:57:02.498298 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:57:02.498054 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53a37ee_b063_4f68_9740_4cb2d845ee58.slice/crio-127a543af6421c4b502fde851a1eb122b3f190260a4896a125af9eb4d9c91c89 WatchSource:0}: Error finding container 127a543af6421c4b502fde851a1eb122b3f190260a4896a125af9eb4d9c91c89: Status 404 returned error can't find the container with id 127a543af6421c4b502fde851a1eb122b3f190260a4896a125af9eb4d9c91c89 Jul 13 02:57:02.500598 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:57:02.500540 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4688ca_bcc1_49d5_8da8_cc55d785be32.slice/crio-16c71aa67f7920c66d1f00405b0c9fd30439fff49641ca0330cd835db5e17d00 WatchSource:0}: Error finding container 16c71aa67f7920c66d1f00405b0c9fd30439fff49641ca0330cd835db5e17d00: Status 404 returned error can't find the container with id 16c71aa67f7920c66d1f00405b0c9fd30439fff49641ca0330cd835db5e17d00 Jul 13 02:57:02.503167 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:57:02.503119 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc339015_ab80_470e_b028_fbfe7dfe72de.slice/crio-fcd7661e2a8842e59e0b31e0cd69d0f2df800749bc445c29137abf8b45c6f8c5 WatchSource:0}: Error finding container fcd7661e2a8842e59e0b31e0cd69d0f2df800749bc445c29137abf8b45c6f8c5: Status 404 returned error can't find the container with id fcd7661e2a8842e59e0b31e0cd69d0f2df800749bc445c29137abf8b45c6f8c5 Jul 13 02:57:02.504531 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:57:02.504486 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa509e31_3c30_48b7_9f01_7f09f51229c6.slice/crio-dd82dfea1a2ae483c08f38e52583b9663419cd391d5c9d4ad2d0b1f38306c408 WatchSource:0}: Error finding container dd82dfea1a2ae483c08f38e52583b9663419cd391d5c9d4ad2d0b1f38306c408: Status 404 returned error can't find the container with id dd82dfea1a2ae483c08f38e52583b9663419cd391d5c9d4ad2d0b1f38306c408 Jul 13 02:57:03.027430 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.027075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:03.027623 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.027444 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:03.027623 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:03.027604 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:03.027741 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:03.027672 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs podName:03bd910c-0e0d-4afd-882a-9510de44edfd nodeName:}" failed. No retries permitted until 2026-07-13 02:57:05.02765215 +0000 UTC m=+6.078459100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs") pod "network-metrics-daemon-nk7sp" (UID: "03bd910c-0e0d-4afd-882a-9510de44edfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:03.028137 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:03.028112 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:03.028247 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:03.028180 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret podName:061e47b1-79f8-4431-8569-de9d25e36495 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:05.028162484 +0000 UTC m=+6.078969435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret") pod "global-pull-secret-syncer-mjztv" (UID: "061e47b1-79f8-4431-8569-de9d25e36495") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:03.128319 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.128269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjkn\" (UniqueName: \"kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn\") pod \"network-check-target-8p9nm\" (UID: \"1e789a2a-0bb1-4e7e-987a-74712da0a3c1\") " pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:03.128524 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:03.128492 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:03.128524 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:03.128515 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:03.128632 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:03.128529 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wfjkn for pod openshift-network-diagnostics/network-check-target-8p9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:03.128632 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:03.128595 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn podName:1e789a2a-0bb1-4e7e-987a-74712da0a3c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:05.128574459 +0000 UTC m=+6.179381410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wfjkn" (UniqueName: "kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn") pod "network-check-target-8p9nm" (UID: "1e789a2a-0bb1-4e7e-987a-74712da0a3c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:03.396570 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.396406 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 02:52:01 +0000 UTC" deadline="2028-01-28 13:23:59.509119732 +0000 UTC" Jul 13 02:57:03.396570 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.396496 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13546h26m56.112628308s" Jul 13 02:57:03.465350 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.465292 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:03.465562 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:03.465446 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:03.510243 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.509384 2563 generic.go:356] "Generic (PLEG): container finished" podID="0adb729e031a71e9be839c4552844512" containerID="1f118a31e0427db16f69b8084b2154481250e5af741dc6cedca8b07f22e9b98c" exitCode=0 Jul 13 02:57:03.510243 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.509742 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" event={"ID":"0adb729e031a71e9be839c4552844512","Type":"ContainerDied","Data":"1f118a31e0427db16f69b8084b2154481250e5af741dc6cedca8b07f22e9b98c"} Jul 13 02:57:03.523157 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.523093 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pqxkj" event={"ID":"d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d","Type":"ContainerStarted","Data":"c0eec1bd4920b2e7cf98c2762d9b0082e8fa02b4c34f194a61545ad11a90cc47"} Jul 13 02:57:03.536582 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.536543 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n6mg" event={"ID":"f75dab3f-51d7-44b4-98fc-b85d6dda202d","Type":"ContainerStarted","Data":"bbd1cb1e82e5f7386f3ecef3d2743a2e223eb6245a532cb0dc54e823f4554fc0"} Jul 13 02:57:03.562176 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.561451 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jv6rr" event={"ID":"cc339015-ab80-470e-b028-fbfe7dfe72de","Type":"ContainerStarted","Data":"fcd7661e2a8842e59e0b31e0cd69d0f2df800749bc445c29137abf8b45c6f8c5"} Jul 13 02:57:03.575651 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.575609 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fpjkd" event={"ID":"5e4688ca-bcc1-49d5-8da8-cc55d785be32","Type":"ContainerStarted","Data":"16c71aa67f7920c66d1f00405b0c9fd30439fff49641ca0330cd835db5e17d00"} Jul 13 02:57:03.603657 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.603536 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" event={"ID":"e53a37ee-b063-4f68-9740-4cb2d845ee58","Type":"ContainerStarted","Data":"127a543af6421c4b502fde851a1eb122b3f190260a4896a125af9eb4d9c91c89"} Jul 13 02:57:03.619222 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.618904 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-225.ec2.internal" event={"ID":"71a205fe70f937e6cd223dd5a6fc736b","Type":"ContainerStarted","Data":"1e863655ff58399419b150a59570bc8c1c6ca8db78ce39d24c7496417e1bd041"} Jul 13 02:57:03.634728 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.634682 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" event={"ID":"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c","Type":"ContainerStarted","Data":"7279930155a1ff1bf26cd9e0c4fd5e3153dc5b2ddafd64bcad9fe9b4544e9073"} Jul 13 02:57:03.683584 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.683388 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8cqcw" event={"ID":"7359c1d2-d166-472c-b46e-c1ed274b850f","Type":"ContainerStarted","Data":"093e48f6716dfe8e10381637290927eb4d6e8b02d23b04bca0351c5cc6692607"} Jul 13 02:57:03.691521 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.691394 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n5xv8" event={"ID":"aa509e31-3c30-48b7-9f01-7f09f51229c6","Type":"ContainerStarted","Data":"dd82dfea1a2ae483c08f38e52583b9663419cd391d5c9d4ad2d0b1f38306c408"} Jul 13 02:57:03.714097 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:03.714002 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" event={"ID":"726a10d4-49e8-42a5-a54c-000a1af43746","Type":"ContainerStarted","Data":"aaa3313eddc7472ff3ab6644393bfe808cbd907d12c352e337692757084bc36b"} Jul 13 02:57:04.462343 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:04.462286 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:04.462851 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:04.462425 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:04.462851 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:04.462645 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:04.462851 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:04.462836 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:04.725627 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:04.725131 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" event={"ID":"0adb729e031a71e9be839c4552844512","Type":"ContainerStarted","Data":"1b4e8d1909917a33888bed9d5bfae6f4674d5393e908bb9473704d826eb512f0"} Jul 13 02:57:04.744912 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:04.744825 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-225.ec2.internal" podStartSLOduration=4.744800178 podStartE2EDuration="4.744800178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:03.636857702 +0000 UTC m=+4.687664663" watchObservedRunningTime="2026-07-13 02:57:04.744800178 +0000 UTC m=+5.795607140" Jul 13 02:57:04.745143 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:04.745040 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-225.ec2.internal" podStartSLOduration=4.745032277 podStartE2EDuration="4.745032277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:04.743774309 +0000 UTC m=+5.794581271" watchObservedRunningTime="2026-07-13 02:57:04.745032277 +0000 UTC m=+5.795839238" Jul 13 02:57:05.049159 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:05.049063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:05.049159 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:05.049132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:05.049393 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:05.049296 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:05.049393 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:05.049370 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret podName:061e47b1-79f8-4431-8569-de9d25e36495 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:09.049348295 +0000 UTC m=+10.100155258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret") pod "global-pull-secret-syncer-mjztv" (UID: "061e47b1-79f8-4431-8569-de9d25e36495") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:05.049776 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:05.049752 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:05.049854 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:05.049799 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs podName:03bd910c-0e0d-4afd-882a-9510de44edfd nodeName:}" failed. No retries permitted until 2026-07-13 02:57:09.049785234 +0000 UTC m=+10.100592169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs") pod "network-metrics-daemon-nk7sp" (UID: "03bd910c-0e0d-4afd-882a-9510de44edfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:05.149508 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:05.149468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjkn\" (UniqueName: \"kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn\") pod \"network-check-target-8p9nm\" (UID: \"1e789a2a-0bb1-4e7e-987a-74712da0a3c1\") " pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:05.149714 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:05.149677 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:05.149714 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:05.149696 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:05.149714 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:05.149707 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wfjkn for pod openshift-network-diagnostics/network-check-target-8p9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:05.149880 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:05.149757 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn podName:1e789a2a-0bb1-4e7e-987a-74712da0a3c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:09.149742922 +0000 UTC m=+10.200549858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wfjkn" (UniqueName: "kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn") pod "network-check-target-8p9nm" (UID: "1e789a2a-0bb1-4e7e-987a-74712da0a3c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:05.464925 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:05.464344 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:05.464925 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:05.464464 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:06.462313 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:06.462276 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:06.462531 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:06.462365 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:06.462531 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:06.462432 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:06.462531 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:06.462477 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:07.465436 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:07.465400 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:07.465866 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:07.465544 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:08.463179 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:08.463127 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:08.463398 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:08.463287 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:08.463726 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:08.463702 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:08.463849 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:08.463818 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:09.087509 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:09.087461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:09.088071 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:09.087555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:09.088071 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:09.087689 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:09.088071 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:09.087750 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs podName:03bd910c-0e0d-4afd-882a-9510de44edfd nodeName:}" failed. No retries permitted until 2026-07-13 02:57:17.087731917 +0000 UTC m=+18.138538853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs") pod "network-metrics-daemon-nk7sp" (UID: "03bd910c-0e0d-4afd-882a-9510de44edfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:09.088279 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:09.088130 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:09.088279 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:09.088199 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret podName:061e47b1-79f8-4431-8569-de9d25e36495 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:17.088183339 +0000 UTC m=+18.138990279 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret") pod "global-pull-secret-syncer-mjztv" (UID: "061e47b1-79f8-4431-8569-de9d25e36495") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:09.188543 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:09.188504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjkn\" (UniqueName: \"kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn\") pod \"network-check-target-8p9nm\" (UID: \"1e789a2a-0bb1-4e7e-987a-74712da0a3c1\") " pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:09.188732 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:09.188718 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:09.188813 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:09.188740 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:09.188813 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:09.188754 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wfjkn for pod openshift-network-diagnostics/network-check-target-8p9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:09.188952 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:09.188820 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn podName:1e789a2a-0bb1-4e7e-987a-74712da0a3c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:17.188801819 +0000 UTC m=+18.239608757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wfjkn" (UniqueName: "kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn") pod "network-check-target-8p9nm" (UID: "1e789a2a-0bb1-4e7e-987a-74712da0a3c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:09.462972 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:09.462938 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:09.463159 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:09.463057 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:10.462314 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:10.462272 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:10.462690 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:10.462417 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:10.462756 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:10.462738 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:10.462887 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:10.462863 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:11.463312 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:11.463280 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:11.463749 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:11.463394 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:12.462973 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:12.462931 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:12.463195 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:12.463063 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:12.463195 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:12.463115 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:12.463337 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:12.463247 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:13.463240 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:13.463202 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:13.463420 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:13.463341 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:14.462522 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:14.462483 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:14.462697 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:14.462631 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:14.463013 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:14.462987 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:14.463164 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:14.463090 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:15.462755 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:15.462718 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:15.463228 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:15.462848 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:16.462939 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:16.462900 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:16.462939 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:16.462936 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:16.463507 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:16.463077 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:16.463507 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:16.463215 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:17.157634 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:17.157574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:17.157816 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:17.157663 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:17.157816 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:17.157769 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:17.157950 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:17.157827 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:17.157950 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:17.157852 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret podName:061e47b1-79f8-4431-8569-de9d25e36495 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:33.157829767 +0000 UTC m=+34.208636706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret") pod "global-pull-secret-syncer-mjztv" (UID: "061e47b1-79f8-4431-8569-de9d25e36495") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:17.157950 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:17.157890 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs podName:03bd910c-0e0d-4afd-882a-9510de44edfd nodeName:}" failed. No retries permitted until 2026-07-13 02:57:33.157872169 +0000 UTC m=+34.208679104 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs") pod "network-metrics-daemon-nk7sp" (UID: "03bd910c-0e0d-4afd-882a-9510de44edfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:17.258795 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:17.258756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjkn\" (UniqueName: \"kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn\") pod \"network-check-target-8p9nm\" (UID: \"1e789a2a-0bb1-4e7e-987a-74712da0a3c1\") " pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:17.258989 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:17.258938 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:17.258989 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:17.258964 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:17.258989 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:17.258976 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wfjkn for pod openshift-network-diagnostics/network-check-target-8p9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:17.259102 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:17.259028 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn podName:1e789a2a-0bb1-4e7e-987a-74712da0a3c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:57:33.259014295 +0000 UTC m=+34.309821229 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wfjkn" (UniqueName: "kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn") pod "network-check-target-8p9nm" (UID: "1e789a2a-0bb1-4e7e-987a-74712da0a3c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:17.462795 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:17.462762 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:17.462989 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:17.462887 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:18.462749 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:18.462706 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:18.462938 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:18.462856 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:18.463312 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:18.463290 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:18.463711 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:18.463395 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:19.463322 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:19.463282 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:19.463840 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:19.463418 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:20.463093 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:20.463053 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:20.463287 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:20.463053 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:20.463287 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:20.463228 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:20.463287 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:20.463248 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:21.462917 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:21.462876 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:21.463341 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:21.463024 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:22.462602 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.462192 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:22.463275 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.462218 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:22.463275 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:22.462738 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:22.463275 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:22.462777 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:22.766067 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.765635 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pqxkj" event={"ID":"d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d","Type":"ContainerStarted","Data":"5e24cce83af1a554d7f37d31aa196c51ef1d9ebe2c6a0dbc24f98a5d6fcbfa36"} Jul 13 02:57:22.767522 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.767486 2563 generic.go:356] "Generic (PLEG): container finished" podID="f75dab3f-51d7-44b4-98fc-b85d6dda202d" containerID="b9d74ed61383ddb142586ace0ca1c1a61d2d65622cd58737e3bd0485382590f4" exitCode=0 Jul 13 02:57:22.767670 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.767587 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n6mg" event={"ID":"f75dab3f-51d7-44b4-98fc-b85d6dda202d","Type":"ContainerDied","Data":"b9d74ed61383ddb142586ace0ca1c1a61d2d65622cd58737e3bd0485382590f4"} Jul 13 02:57:22.773847 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.773749 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jv6rr" event={"ID":"cc339015-ab80-470e-b028-fbfe7dfe72de","Type":"ContainerStarted","Data":"33fb68a46ebafa12b28e0887c3ae8045a8d4378bf22042a9c757405b5679a499"} Jul 13 02:57:22.777480 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.777452 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" event={"ID":"e53a37ee-b063-4f68-9740-4cb2d845ee58","Type":"ContainerStarted","Data":"949028f6eeb439ca7b6b5931aec5caaa75087e111556941963547cabb7a781b2"} Jul 13 02:57:22.777596 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.777575 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" event={"ID":"e53a37ee-b063-4f68-9740-4cb2d845ee58","Type":"ContainerStarted","Data":"36eb7f658be9c5b27d238cc2c23bf1d96c3b4798541eda93b8d884ac84e3200b"} Jul 13 02:57:22.777658 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.777630 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" event={"ID":"e53a37ee-b063-4f68-9740-4cb2d845ee58","Type":"ContainerStarted","Data":"92e82f5b32972c137e60e9f3bdc13be8afbd7f8ff1f5a8d1f069bfdda3e69189"} Jul 13 02:57:22.777711 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.777677 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" event={"ID":"e53a37ee-b063-4f68-9740-4cb2d845ee58","Type":"ContainerStarted","Data":"e06810ba4c73fa6897649d73d73d6b6feb413c0701aeab2f462eabbdefadeb1f"} Jul 13 02:57:22.777769 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.777722 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" event={"ID":"e53a37ee-b063-4f68-9740-4cb2d845ee58","Type":"ContainerStarted","Data":"7e90fab39533da0228e52b4fcb54e54bf7cd4f9443de365fca249a012da223d3"} Jul 13 02:57:22.777769 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.777752 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" event={"ID":"e53a37ee-b063-4f68-9740-4cb2d845ee58","Type":"ContainerStarted","Data":"94c13905b56fbc2b058020835b6fa099f22a178de36f31f8518bf3f3df3f0dee"} Jul 13 02:57:22.779216 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.779181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" event={"ID":"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c","Type":"ContainerStarted","Data":"fc758430c52f035d379211f58dd1dcd2c8c26ad413d3bb2e5150a8ac71c7ca28"} Jul 13 02:57:22.780714 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.780693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8cqcw" event={"ID":"7359c1d2-d166-472c-b46e-c1ed274b850f","Type":"ContainerStarted","Data":"516e2defc798ac071ee838917e8fb0294575eec14c2c7410a09b878cc48481c7"} Jul 13 02:57:22.782539 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.782518 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-n5xv8" event={"ID":"aa509e31-3c30-48b7-9f01-7f09f51229c6","Type":"ContainerStarted","Data":"d6c57ca5a890155f19027c42adef2b27ab950fc9332647d227199413a15f841e"} Jul 13 02:57:22.784497 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.784466 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" event={"ID":"726a10d4-49e8-42a5-a54c-000a1af43746","Type":"ContainerStarted","Data":"8ee6adf90f5749fa6141eea673381841687a0404d735bf75827bc92943c9d150"} Jul 13 02:57:22.784628 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.784577 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pqxkj" podStartSLOduration=4.474569345 podStartE2EDuration="23.784560776s" totalImagesPullingTime="19.309991431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:22.784326161 +0000 UTC m=+23.835133121" watchObservedRunningTime="2026-07-13 02:57:22.784560776 +0000 UTC m=+23.835367736" Jul 13 02:57:22.799779 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.799715 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8cqcw" podStartSLOduration=4.489750143 podStartE2EDuration="23.799693503s" totalImagesPullingTime="19.30994336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:22.799030422 +0000 UTC m=+23.849837381" watchObservedRunningTime="2026-07-13 02:57:22.799693503 +0000 UTC m=+23.850500462" Jul 13 02:57:22.839260 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.839193 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jv6rr" podStartSLOduration=4.463653017 podStartE2EDuration="23.839172016s" totalImagesPullingTime="19.375518999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:22.838720938 +0000 UTC m=+23.889527908" watchObservedRunningTime="2026-07-13 02:57:22.839172016 +0000 UTC m=+23.889978978" Jul 13 02:57:22.853992 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.853930 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-n5xv8" podStartSLOduration=12.647556538 podStartE2EDuration="23.853882365s" totalImagesPullingTime="11.206325827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:22.85288186 +0000 UTC m=+23.903688819" watchObservedRunningTime="2026-07-13 02:57:22.853882365 +0000 UTC m=+23.904689323" Jul 13 02:57:22.871998 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:22.871942 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t6jd7" podStartSLOduration=4.523819043 podStartE2EDuration="23.871920908s" totalImagesPullingTime="19.348101865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:22.871785507 +0000 UTC m=+23.922592466" watchObservedRunningTime="2026-07-13 02:57:22.871920908 +0000 UTC m=+23.922727866" Jul 13 02:57:23.330845 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:23.330811 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 02:57:23.366547 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:23.366436 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T02:57:23.330838408Z","UUID":"bb5a5785-b8d0-4585-bbea-c74b87a0ded4","Handler":null,"Name":"","Endpoint":""} Jul 13 02:57:23.368330 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:23.368296 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 02:57:23.368458 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:23.368338 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 02:57:23.462984 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:23.462942 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:23.463527 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:23.463052 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:23.788656 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:23.788566 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fpjkd" event={"ID":"5e4688ca-bcc1-49d5-8da8-cc55d785be32","Type":"ContainerStarted","Data":"ae7dfe0e7465484d8f013d01bb2c8d6f2abc9ebb68cda96ec649f40e55a739e4"} Jul 13 02:57:23.790909 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:23.790866 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" event={"ID":"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c","Type":"ContainerStarted","Data":"228eea69b00659afed5b1967684a8045b549980ee114b76e1e3effb5169973ea"} Jul 13 02:57:23.804795 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:23.804726 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fpjkd" podStartSLOduration=5.464471765 podStartE2EDuration="24.804703821s" totalImagesPullingTime="19.340232056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:23.804069987 +0000 UTC m=+24.854876945" watchObservedRunningTime="2026-07-13 02:57:23.804703821 +0000 UTC m=+24.855510781" Jul 13 02:57:24.436472 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:24.436399 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-n5xv8" Jul 13 02:57:24.437203 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:24.437174 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-n5xv8" Jul 13 02:57:24.462440 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:24.462400 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:24.462640 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:24.462518 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:24.462920 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:24.462901 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:24.462999 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:24.462984 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:24.797169 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:24.797112 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" event={"ID":"c2dfbff2-a0a2-4c19-a6d4-5d9888c8f08c","Type":"ContainerStarted","Data":"98ff4145d8d1cf5c8fd4f9cc8f619c0283c7ed482dd40acb4360476dd5755729"} Jul 13 02:57:24.807710 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:24.807642 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-n5xv8" Jul 13 02:57:24.808101 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:24.808076 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-n5xv8" Jul 13 02:57:24.824822 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:24.824775 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cq8pk" podStartSLOduration=4.244109844 podStartE2EDuration="25.824756276s" totalImagesPullingTime="21.580646432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:24.824389467 +0000 UTC m=+25.875196423" watchObservedRunningTime="2026-07-13 02:57:24.824756276 +0000 UTC m=+25.875563233" Jul 13 02:57:25.462637 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:25.462600 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:25.462850 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:25.462734 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:25.803487 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:25.803393 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" event={"ID":"e53a37ee-b063-4f68-9740-4cb2d845ee58","Type":"ContainerStarted","Data":"5f10c1b546298df25ba05e8a4e12e342dace002022c646746bc97520fe7cab59"} Jul 13 02:57:26.462460 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:26.462227 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:26.462662 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:26.462262 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:26.462662 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:26.462560 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:26.462662 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:26.462638 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:27.463534 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:27.463248 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:27.464306 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:27.463649 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:27.809984 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:27.809868 2563 generic.go:356] "Generic (PLEG): container finished" podID="f75dab3f-51d7-44b4-98fc-b85d6dda202d" containerID="bf4219f9e355102d1275ed7f71c0e9905f70013e88eedad3701db7b1be3c5a8d" exitCode=0 Jul 13 02:57:27.809984 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:27.809954 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n6mg" event={"ID":"f75dab3f-51d7-44b4-98fc-b85d6dda202d","Type":"ContainerDied","Data":"bf4219f9e355102d1275ed7f71c0e9905f70013e88eedad3701db7b1be3c5a8d"} Jul 13 02:57:27.813714 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:27.813683 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" event={"ID":"e53a37ee-b063-4f68-9740-4cb2d845ee58","Type":"ContainerStarted","Data":"798cf9e70a0b6526277d75b4ca6147aa85687c5283f70137d7a151383a435803"} Jul 13 02:57:27.813964 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:27.813936 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:27.814080 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:27.814001 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:27.831327 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:27.831296 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:27.831640 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:27.831405 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:27.862436 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:27.862373 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" podStartSLOduration=8.445619493 podStartE2EDuration="27.862354417s" totalImagesPullingTime="19.416734924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:27.861824965 +0000 UTC m=+28.912631922" watchObservedRunningTime="2026-07-13 02:57:27.862354417 +0000 UTC m=+28.913161373" Jul 13 02:57:28.462204 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:28.462160 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:28.462204 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:28.462201 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:28.462509 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:28.462315 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:28.462509 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:28.462425 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:28.816332 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:28.816259 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:57:29.226849 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:29.226802 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mjztv"] Jul 13 02:57:29.227123 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:29.226947 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:29.227123 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:29.227064 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:29.227673 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:29.227647 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8p9nm"] Jul 13 02:57:29.227811 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:29.227739 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:29.227865 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:29.227818 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:29.228453 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:29.228433 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nk7sp"] Jul 13 02:57:29.228556 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:29.228542 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:29.228686 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:29.228663 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:29.820695 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:29.820656 2563 generic.go:356] "Generic (PLEG): container finished" podID="f75dab3f-51d7-44b4-98fc-b85d6dda202d" containerID="cad50e1db0dac6bc25a244242b0941c949dc467251af85460107fdb0ca99123e" exitCode=0 Jul 13 02:57:29.821305 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:29.820758 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n6mg" event={"ID":"f75dab3f-51d7-44b4-98fc-b85d6dda202d","Type":"ContainerDied","Data":"cad50e1db0dac6bc25a244242b0941c949dc467251af85460107fdb0ca99123e"} Jul 13 02:57:30.462201 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:30.462165 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:30.462372 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:30.462213 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:30.462372 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:30.462287 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:30.462447 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:30.462400 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:31.462609 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:31.462423 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:31.463015 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:31.462704 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:31.827977 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:31.827941 2563 generic.go:356] "Generic (PLEG): container finished" podID="f75dab3f-51d7-44b4-98fc-b85d6dda202d" containerID="6af0006b1ae899b4210fd13249cf916572ba473ccd2bf1f9ec7df0953efff6f7" exitCode=0 Jul 13 02:57:31.828188 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:31.828006 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n6mg" event={"ID":"f75dab3f-51d7-44b4-98fc-b85d6dda202d","Type":"ContainerDied","Data":"6af0006b1ae899b4210fd13249cf916572ba473ccd2bf1f9ec7df0953efff6f7"} Jul 13 02:57:32.462361 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:32.462325 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:32.462361 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:32.462370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:32.462652 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:32.462476 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:32.462652 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:32.462544 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:33.192283 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:33.192243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:33.192474 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:33.192327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:33.192474 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:33.192466 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:33.192569 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:33.192532 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret podName:061e47b1-79f8-4431-8569-de9d25e36495 nodeName:}" failed. No retries permitted until 2026-07-13 02:58:05.192510474 +0000 UTC m=+66.243317455 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret") pod "global-pull-secret-syncer-mjztv" (UID: "061e47b1-79f8-4431-8569-de9d25e36495") : object "kube-system"/"original-pull-secret" not registered Jul 13 02:57:33.192616 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:33.192598 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:33.192652 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:33.192630 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs podName:03bd910c-0e0d-4afd-882a-9510de44edfd nodeName:}" failed. No retries permitted until 2026-07-13 02:58:05.19261845 +0000 UTC m=+66.243425391 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs") pod "network-metrics-daemon-nk7sp" (UID: "03bd910c-0e0d-4afd-882a-9510de44edfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 02:57:33.292818 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:33.292781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjkn\" (UniqueName: \"kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn\") pod \"network-check-target-8p9nm\" (UID: \"1e789a2a-0bb1-4e7e-987a-74712da0a3c1\") " pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:33.293003 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:33.292978 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 02:57:33.293048 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:33.293007 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 02:57:33.293048 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:33.293022 2563 projected.go:196] Error preparing data for projected volume kube-api-access-wfjkn for pod openshift-network-diagnostics/network-check-target-8p9nm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:33.293118 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:33.293092 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn podName:1e789a2a-0bb1-4e7e-987a-74712da0a3c1 nodeName:}" failed. No retries permitted until 2026-07-13 02:58:05.293070585 +0000 UTC m=+66.343877540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wfjkn" (UniqueName: "kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn") pod "network-check-target-8p9nm" (UID: "1e789a2a-0bb1-4e7e-987a-74712da0a3c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 02:57:33.462394 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:33.462354 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:33.462587 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:33.462490 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8p9nm" podUID="1e789a2a-0bb1-4e7e-987a-74712da0a3c1" Jul 13 02:57:34.462501 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.462464 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:34.463039 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.462467 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:34.463039 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:34.462597 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjztv" podUID="061e47b1-79f8-4431-8569-de9d25e36495" Jul 13 02:57:34.463039 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:34.462704 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:57:34.748029 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.747994 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-225.ec2.internal" event="NodeReady" Jul 13 02:57:34.748238 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.748182 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 02:57:34.794393 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.794358 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fshqz"] Jul 13 02:57:34.799380 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.799346 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7rlxp"] Jul 13 02:57:34.799567 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.799486 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:34.802435 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.802407 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vw8zn\"" Jul 13 02:57:34.802595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.802465 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 02:57:34.802595 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.802408 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 02:57:34.802905 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.802887 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7rlxp" Jul 13 02:57:34.805545 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.805515 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 02:57:34.805669 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.805572 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 02:57:34.805669 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.805572 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 02:57:34.805669 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.805645 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9bqmq\"" Jul 13 02:57:34.810541 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.810277 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fshqz"] Jul 13 02:57:34.822631 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.822601 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7rlxp"] Jul 13 02:57:34.905533 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.905493 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b30fb41b-3f0b-4428-a776-d07b8c2d071f-tmp-dir\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:34.905533 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.905537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:34.905809 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.905573 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b30fb41b-3f0b-4428-a776-d07b8c2d071f-config-volume\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:34.905809 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.905644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cqj2\" (UniqueName: \"kubernetes.io/projected/b30fb41b-3f0b-4428-a776-d07b8c2d071f-kube-api-access-5cqj2\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:34.905809 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.905673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbba74a8-4ac0-48db-8236-d8951b76f810-cert\") pod \"ingress-canary-7rlxp\" (UID: \"bbba74a8-4ac0-48db-8236-d8951b76f810\") " pod="openshift-ingress-canary/ingress-canary-7rlxp" Jul 13 02:57:34.905809 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:34.905690 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl6lp\" (UniqueName: \"kubernetes.io/projected/bbba74a8-4ac0-48db-8236-d8951b76f810-kube-api-access-xl6lp\") pod \"ingress-canary-7rlxp\" (UID: \"bbba74a8-4ac0-48db-8236-d8951b76f810\") " pod="openshift-ingress-canary/ingress-canary-7rlxp" Jul 13 02:57:35.006925 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.006826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b30fb41b-3f0b-4428-a776-d07b8c2d071f-tmp-dir\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:35.006925 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.006878 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:35.006925 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.006917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b30fb41b-3f0b-4428-a776-d07b8c2d071f-config-volume\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:35.007229 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.006945 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cqj2\" (UniqueName: \"kubernetes.io/projected/b30fb41b-3f0b-4428-a776-d07b8c2d071f-kube-api-access-5cqj2\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:35.007229 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.006970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbba74a8-4ac0-48db-8236-d8951b76f810-cert\") pod \"ingress-canary-7rlxp\" (UID: \"bbba74a8-4ac0-48db-8236-d8951b76f810\") " pod="openshift-ingress-canary/ingress-canary-7rlxp" Jul 13 02:57:35.007229 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.006987 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl6lp\" (UniqueName: \"kubernetes.io/projected/bbba74a8-4ac0-48db-8236-d8951b76f810-kube-api-access-xl6lp\") pod \"ingress-canary-7rlxp\" (UID: \"bbba74a8-4ac0-48db-8236-d8951b76f810\") " pod="openshift-ingress-canary/ingress-canary-7rlxp" Jul 13 02:57:35.007229 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:35.007064 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:57:35.007229 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:35.007131 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls podName:b30fb41b-3f0b-4428-a776-d07b8c2d071f nodeName:}" failed. No retries permitted until 2026-07-13 02:57:35.507114581 +0000 UTC m=+36.557921516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls") pod "dns-default-fshqz" (UID: "b30fb41b-3f0b-4428-a776-d07b8c2d071f") : secret "dns-default-metrics-tls" not found Jul 13 02:57:35.007489 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.007245 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b30fb41b-3f0b-4428-a776-d07b8c2d071f-tmp-dir\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:35.007773 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.007749 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b30fb41b-3f0b-4428-a776-d07b8c2d071f-config-volume\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:35.012385 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.012359 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbba74a8-4ac0-48db-8236-d8951b76f810-cert\") pod \"ingress-canary-7rlxp\" (UID: \"bbba74a8-4ac0-48db-8236-d8951b76f810\") " pod="openshift-ingress-canary/ingress-canary-7rlxp" Jul 13 02:57:35.017704 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.017674 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl6lp\" (UniqueName: \"kubernetes.io/projected/bbba74a8-4ac0-48db-8236-d8951b76f810-kube-api-access-xl6lp\") pod \"ingress-canary-7rlxp\" (UID: \"bbba74a8-4ac0-48db-8236-d8951b76f810\") " pod="openshift-ingress-canary/ingress-canary-7rlxp" Jul 13 02:57:35.017849 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.017712 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cqj2\" (UniqueName: \"kubernetes.io/projected/b30fb41b-3f0b-4428-a776-d07b8c2d071f-kube-api-access-5cqj2\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:35.118388 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.118351 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7rlxp" Jul 13 02:57:35.462420 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.462381 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:57:35.465519 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.465489 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 02:57:35.466663 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.466640 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 02:57:35.466833 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.466640 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nv65t\"" Jul 13 02:57:35.511374 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.510782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:35.511374 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:35.510931 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:57:35.511374 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:35.510995 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls podName:b30fb41b-3f0b-4428-a776-d07b8c2d071f nodeName:}" failed. No retries permitted until 2026-07-13 02:57:36.510975697 +0000 UTC m=+37.561782637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls") pod "dns-default-fshqz" (UID: "b30fb41b-3f0b-4428-a776-d07b8c2d071f") : secret "dns-default-metrics-tls" not found Jul 13 02:57:35.898675 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:35.898419 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7rlxp"] Jul 13 02:57:35.902620 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:57:35.902593 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbba74a8_4ac0_48db_8236_d8951b76f810.slice/crio-086089e20ed01d9d449bb7ce16792465991efea15fc88e2bc9cc6a1e70a8dbf5 WatchSource:0}: Error finding container 086089e20ed01d9d449bb7ce16792465991efea15fc88e2bc9cc6a1e70a8dbf5: Status 404 returned error can't find the container with id 086089e20ed01d9d449bb7ce16792465991efea15fc88e2bc9cc6a1e70a8dbf5 Jul 13 02:57:36.462683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:36.462643 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:57:36.462683 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:36.462664 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:57:36.466941 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:36.466913 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8nlv8\"" Jul 13 02:57:36.467353 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:36.466948 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 02:57:36.467353 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:36.467223 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 02:57:36.518818 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:36.518768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:36.518997 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:36.518917 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:57:36.518997 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:36.518979 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls podName:b30fb41b-3f0b-4428-a776-d07b8c2d071f nodeName:}" failed. No retries permitted until 2026-07-13 02:57:38.518963139 +0000 UTC m=+39.569770074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls") pod "dns-default-fshqz" (UID: "b30fb41b-3f0b-4428-a776-d07b8c2d071f") : secret "dns-default-metrics-tls" not found Jul 13 02:57:36.846362 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:36.846074 2563 generic.go:356] "Generic (PLEG): container finished" podID="f75dab3f-51d7-44b4-98fc-b85d6dda202d" containerID="9124b102346f60ddfcc42867000cca7f71b415934a89500ea9c4b122c1d38880" exitCode=0 Jul 13 02:57:36.846362 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:36.846200 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n6mg" event={"ID":"f75dab3f-51d7-44b4-98fc-b85d6dda202d","Type":"ContainerDied","Data":"9124b102346f60ddfcc42867000cca7f71b415934a89500ea9c4b122c1d38880"} Jul 13 02:57:36.848969 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:36.848932 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7rlxp" event={"ID":"bbba74a8-4ac0-48db-8236-d8951b76f810","Type":"ContainerStarted","Data":"086089e20ed01d9d449bb7ce16792465991efea15fc88e2bc9cc6a1e70a8dbf5"} Jul 13 02:57:37.855917 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:37.855875 2563 generic.go:356] "Generic (PLEG): container finished" podID="f75dab3f-51d7-44b4-98fc-b85d6dda202d" containerID="3e1d09c432c8bc42d9521906bb468b1ea2dc4459bd901ffa8cec4dac4820b704" exitCode=0 Jul 13 02:57:37.856490 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:37.855962 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n6mg" event={"ID":"f75dab3f-51d7-44b4-98fc-b85d6dda202d","Type":"ContainerDied","Data":"3e1d09c432c8bc42d9521906bb468b1ea2dc4459bd901ffa8cec4dac4820b704"} Jul 13 02:57:38.534631 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:38.534386 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:38.534631 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:38.534557 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:57:38.534843 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:38.534641 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls podName:b30fb41b-3f0b-4428-a776-d07b8c2d071f nodeName:}" failed. No retries permitted until 2026-07-13 02:57:42.534626328 +0000 UTC m=+43.585433263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls") pod "dns-default-fshqz" (UID: "b30fb41b-3f0b-4428-a776-d07b8c2d071f") : secret "dns-default-metrics-tls" not found Jul 13 02:57:38.862460 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:38.862373 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2n6mg" event={"ID":"f75dab3f-51d7-44b4-98fc-b85d6dda202d","Type":"ContainerStarted","Data":"b291772a0601a226cc58054d7b8a8e7dc946f60dfb14fb88f1f95e10e735eedd"} Jul 13 02:57:38.864050 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:38.864025 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7rlxp" event={"ID":"bbba74a8-4ac0-48db-8236-d8951b76f810","Type":"ContainerStarted","Data":"c695a7abae8c23ce01aa31d14f163f42d61f7120ae778ed8d7662f6a7cbfa327"} Jul 13 02:57:38.886278 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:38.886124 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2n6mg" podStartSLOduration=10.265492109 podStartE2EDuration="39.886105815s" totalImagesPullingTime="29.620613706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:38.884569627 +0000 UTC m=+39.935376587" watchObservedRunningTime="2026-07-13 02:57:38.886105815 +0000 UTC m=+39.936912750" Jul 13 02:57:38.899270 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:38.899206 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7rlxp" podStartSLOduration=2.610665243 podStartE2EDuration="4.899183987s" totalImagesPullingTime="2.288518744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:57:38.89903713 +0000 UTC m=+39.949844087" watchObservedRunningTime="2026-07-13 02:57:38.899183987 +0000 UTC m=+39.949990945" Jul 13 02:57:42.562847 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:42.562800 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:42.563336 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:42.562949 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:57:42.563336 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:42.563026 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls podName:b30fb41b-3f0b-4428-a776-d07b8c2d071f nodeName:}" failed. No retries permitted until 2026-07-13 02:57:50.563008606 +0000 UTC m=+51.613815543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls") pod "dns-default-fshqz" (UID: "b30fb41b-3f0b-4428-a776-d07b8c2d071f") : secret "dns-default-metrics-tls" not found Jul 13 02:57:50.614101 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:50.614046 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:57:50.614628 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:50.614211 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:57:50.614628 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:57:50.614289 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls podName:b30fb41b-3f0b-4428-a776-d07b8c2d071f nodeName:}" failed. No retries permitted until 2026-07-13 02:58:06.614271505 +0000 UTC m=+67.665078440 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls") pod "dns-default-fshqz" (UID: "b30fb41b-3f0b-4428-a776-d07b8c2d071f") : secret "dns-default-metrics-tls" not found Jul 13 02:57:59.838116 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:57:59.838085 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p2jhl" Jul 13 02:58:05.225363 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.225308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:58:05.225363 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.225380 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:58:05.228633 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.228607 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 02:58:05.228760 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.228653 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 02:58:05.235934 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:58:05.235905 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 13 02:58:05.236008 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:58:05.235976 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs podName:03bd910c-0e0d-4afd-882a-9510de44edfd nodeName:}" failed. No retries permitted until 2026-07-13 02:59:09.235957266 +0000 UTC m=+130.286764201 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs") pod "network-metrics-daemon-nk7sp" (UID: "03bd910c-0e0d-4afd-882a-9510de44edfd") : secret "metrics-daemon-secret" not found Jul 13 02:58:05.239952 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.239924 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/061e47b1-79f8-4431-8569-de9d25e36495-original-pull-secret\") pod \"global-pull-secret-syncer-mjztv\" (UID: \"061e47b1-79f8-4431-8569-de9d25e36495\") " pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:58:05.281300 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.281256 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjztv" Jul 13 02:58:05.326288 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.326243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjkn\" (UniqueName: \"kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn\") pod \"network-check-target-8p9nm\" (UID: \"1e789a2a-0bb1-4e7e-987a-74712da0a3c1\") " pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:58:05.329556 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.329525 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 02:58:05.340070 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.340035 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 02:58:05.351589 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.351559 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfjkn\" (UniqueName: \"kubernetes.io/projected/1e789a2a-0bb1-4e7e-987a-74712da0a3c1-kube-api-access-wfjkn\") pod \"network-check-target-8p9nm\" (UID: \"1e789a2a-0bb1-4e7e-987a-74712da0a3c1\") " pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:58:05.417245 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.417209 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mjztv"] Jul 13 02:58:05.420887 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:58:05.420839 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061e47b1_79f8_4431_8569_de9d25e36495.slice/crio-d2b7c47ddac75099a2de66b27a6610d055fd9eedd1846fa9fc9047d5a259cdf3 WatchSource:0}: Error finding container d2b7c47ddac75099a2de66b27a6610d055fd9eedd1846fa9fc9047d5a259cdf3: Status 404 returned error can't find the container with id d2b7c47ddac75099a2de66b27a6610d055fd9eedd1846fa9fc9047d5a259cdf3 Jul 13 02:58:05.477532 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.477439 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nv65t\"" Jul 13 02:58:05.484847 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.484819 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:58:05.614888 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.614856 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8p9nm"] Jul 13 02:58:05.618270 ip-10-0-130-225 kubenswrapper[2563]: W0713 02:58:05.618243 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e789a2a_0bb1_4e7e_987a_74712da0a3c1.slice/crio-ac15f2096cdc2b5092d0dd5be80faf17c2a334da0c3192d9161560b27d75000b WatchSource:0}: Error finding container ac15f2096cdc2b5092d0dd5be80faf17c2a334da0c3192d9161560b27d75000b: Status 404 returned error can't find the container with id ac15f2096cdc2b5092d0dd5be80faf17c2a334da0c3192d9161560b27d75000b Jul 13 02:58:05.932107 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.932011 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mjztv" event={"ID":"061e47b1-79f8-4431-8569-de9d25e36495","Type":"ContainerStarted","Data":"d2b7c47ddac75099a2de66b27a6610d055fd9eedd1846fa9fc9047d5a259cdf3"} Jul 13 02:58:05.933603 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:05.933574 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8p9nm" event={"ID":"1e789a2a-0bb1-4e7e-987a-74712da0a3c1","Type":"ContainerStarted","Data":"ac15f2096cdc2b5092d0dd5be80faf17c2a334da0c3192d9161560b27d75000b"} Jul 13 02:58:06.637906 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:06.637859 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:58:06.638409 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:58:06.638039 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:58:06.638409 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:58:06.638118 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls podName:b30fb41b-3f0b-4428-a776-d07b8c2d071f nodeName:}" failed. No retries permitted until 2026-07-13 02:58:38.638097895 +0000 UTC m=+99.688904847 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls") pod "dns-default-fshqz" (UID: "b30fb41b-3f0b-4428-a776-d07b8c2d071f") : secret "dns-default-metrics-tls" not found Jul 13 02:58:10.949473 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:10.949432 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8p9nm" event={"ID":"1e789a2a-0bb1-4e7e-987a-74712da0a3c1","Type":"ContainerStarted","Data":"4ebd7d3a5b5dd2f2762731a488c7f8e352558bc5ae546bc0dca37c00f203d58a"} Jul 13 02:58:10.950030 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:10.949566 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:58:10.951055 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:10.951031 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mjztv" event={"ID":"061e47b1-79f8-4431-8569-de9d25e36495","Type":"ContainerStarted","Data":"4ccd712011756c0e7bc93bb8475b0fbfda24347c73360f2bb209dca878306ae2"} Jul 13 02:58:10.965587 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:10.965533 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8p9nm" podStartSLOduration=67.552547898 podStartE2EDuration="1m11.965516497s" totalImagesPullingTime="4.412968599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:58:10.964858121 +0000 UTC m=+72.015665078" watchObservedRunningTime="2026-07-13 02:58:10.965516497 +0000 UTC m=+72.016323498" Jul 13 02:58:10.980737 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:10.980678 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mjztv" podStartSLOduration=66.368027717 podStartE2EDuration="1m10.98065852s" totalImagesPullingTime="4.612630803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 02:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 02:58:10.979491096 +0000 UTC m=+72.030298053" watchObservedRunningTime="2026-07-13 02:58:10.98065852 +0000 UTC m=+72.031465477" Jul 13 02:58:38.671313 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:38.671271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:58:38.671686 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:58:38.671413 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:58:38.671686 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:58:38.671478 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls podName:b30fb41b-3f0b-4428-a776-d07b8c2d071f nodeName:}" failed. No retries permitted until 2026-07-13 02:59:42.671461733 +0000 UTC m=+163.722268668 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls") pod "dns-default-fshqz" (UID: "b30fb41b-3f0b-4428-a776-d07b8c2d071f") : secret "dns-default-metrics-tls" not found Jul 13 02:58:41.956012 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:58:41.955982 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8p9nm" Jul 13 02:59:09.288555 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:59:09.288518 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 02:59:09.289121 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:59:09.288658 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 13 02:59:09.289121 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:59:09.288735 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs podName:03bd910c-0e0d-4afd-882a-9510de44edfd nodeName:}" failed. No retries permitted until 2026-07-13 03:01:11.288714756 +0000 UTC m=+252.339521710 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs") pod "network-metrics-daemon-nk7sp" (UID: "03bd910c-0e0d-4afd-882a-9510de44edfd") : secret "metrics-daemon-secret" not found Jul 13 02:59:37.813367 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:59:37.813316 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fshqz" podUID="b30fb41b-3f0b-4428-a776-d07b8c2d071f" Jul 13 02:59:38.159047 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:59:38.158972 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fshqz" Jul 13 02:59:39.474111 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:59:39.474075 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nk7sp" podUID="03bd910c-0e0d-4afd-882a-9510de44edfd" Jul 13 02:59:42.707125 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:59:42.707075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 02:59:42.707561 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:59:42.707229 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 02:59:42.707561 ip-10-0-130-225 kubenswrapper[2563]: E0713 02:59:42.707297 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls podName:b30fb41b-3f0b-4428-a776-d07b8c2d071f nodeName:}" failed. No retries permitted until 2026-07-13 03:01:44.707282351 +0000 UTC m=+285.758089286 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls") pod "dns-default-fshqz" (UID: "b30fb41b-3f0b-4428-a776-d07b8c2d071f") : secret "dns-default-metrics-tls" not found Jul 13 02:59:54.462431 ip-10-0-130-225 kubenswrapper[2563]: I0713 02:59:54.462326 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 03:00:48.500449 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.500407 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp"] Jul 13 03:00:48.503274 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.503255 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ggnr5"] Jul 13 03:00:48.503396 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.503376 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" Jul 13 03:00:48.506101 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.506077 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-stvgf"] Jul 13 03:00:48.506252 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.506231 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.506292 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.506273 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 13 03:00:48.506587 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.506555 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 13 03:00:48.506772 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.506754 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tqjhf\"" Jul 13 03:00:48.506984 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.506968 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 13 03:00:48.507573 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.507558 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:00:48.508807 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.508785 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-stvgf" Jul 13 03:00:48.509507 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.509487 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 13 03:00:48.509731 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.509715 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 03:00:48.510387 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.510369 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2rp9q\"" Jul 13 03:00:48.510489 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.510453 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 03:00:48.510553 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.510493 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 13 03:00:48.511869 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.511848 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-q4984\"" Jul 13 03:00:48.515284 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.515256 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 13 03:00:48.521591 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.521565 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-stvgf"] Jul 13 03:00:48.526313 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.526277 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ggnr5"] Jul 13 03:00:48.552871 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.552839 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp"] Jul 13 03:00:48.597403 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.597361 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx"] Jul 13 03:00:48.600343 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.600315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:48.601060 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.601033 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-5qxrj"] Jul 13 03:00:48.603376 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.603349 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 13 03:00:48.603513 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.603500 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bk8xk\"" Jul 13 03:00:48.603570 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.603536 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 03:00:48.603612 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.603573 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 13 03:00:48.603675 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.603662 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 03:00:48.604235 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.604221 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6"] Jul 13 03:00:48.604397 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.604380 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.606543 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.606509 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 13 03:00:48.606835 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.606818 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:00:48.606835 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.606829 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-fsq6n\"" Jul 13 03:00:48.607119 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.607103 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:00:48.608678 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.608660 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 13 03:00:48.608784 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.608661 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 13 03:00:48.610059 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.610038 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 13 03:00:48.610385 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.610360 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:00:48.610498 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.610360 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gq7mw\"" Jul 13 03:00:48.610560 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.610367 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 13 03:00:48.611344 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.611322 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx"] Jul 13 03:00:48.613885 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.613865 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 13 03:00:48.618194 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.618169 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6"] Jul 13 03:00:48.618940 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.618920 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-5qxrj"] Jul 13 03:00:48.665204 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.665164 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cc96dbc-0428-466b-abf1-b79890000d7b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-4b9bp\" (UID: \"3cc96dbc-0428-466b-abf1-b79890000d7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" Jul 13 03:00:48.665400 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.665242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.665400 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.665262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9wkt\" (UniqueName: \"kubernetes.io/projected/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-kube-api-access-r9wkt\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.665400 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.665295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79ft8\" (UniqueName: \"kubernetes.io/projected/3cc96dbc-0428-466b-abf1-b79890000d7b-kube-api-access-79ft8\") pod \"kube-storage-version-migrator-operator-799cb7f958-4b9bp\" (UID: \"3cc96dbc-0428-466b-abf1-b79890000d7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" Jul 13 03:00:48.665400 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.665321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cc96dbc-0428-466b-abf1-b79890000d7b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-4b9bp\" (UID: \"3cc96dbc-0428-466b-abf1-b79890000d7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" Jul 13 03:00:48.665400 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.665345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.665400 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.665383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-tmp\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.665659 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.665445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-snapshots\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.665659 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.665483 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-serving-cert\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.665659 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.665515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmvwl\" (UniqueName: \"kubernetes.io/projected/696af790-9f77-4d1e-a284-3f08d039af86-kube-api-access-mmvwl\") pod \"network-check-source-869dcfcdcd-stvgf\" (UID: \"696af790-9f77-4d1e-a284-3f08d039af86\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-stvgf" Jul 13 03:00:48.766911 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.766811 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cc96dbc-0428-466b-abf1-b79890000d7b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-4b9bp\" (UID: \"3cc96dbc-0428-466b-abf1-b79890000d7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" Jul 13 03:00:48.766911 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.766871 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dkbk6\" (UID: \"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:00:48.766911 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.766900 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.767214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.766925 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9wkt\" (UniqueName: \"kubernetes.io/projected/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-kube-api-access-r9wkt\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.767214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.766948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:48.767214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.766971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/652d8372-f1b2-440e-9282-d1226a028bf9-config\") pod \"console-operator-7866497494-5qxrj\" (UID: \"652d8372-f1b2-440e-9282-d1226a028bf9\") " pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.767214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.766991 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/652d8372-f1b2-440e-9282-d1226a028bf9-serving-cert\") pod \"console-operator-7866497494-5qxrj\" (UID: \"652d8372-f1b2-440e-9282-d1226a028bf9\") " pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.767214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767012 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/652d8372-f1b2-440e-9282-d1226a028bf9-trusted-ca\") pod \"console-operator-7866497494-5qxrj\" (UID: \"652d8372-f1b2-440e-9282-d1226a028bf9\") " pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.767214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79ft8\" (UniqueName: \"kubernetes.io/projected/3cc96dbc-0428-466b-abf1-b79890000d7b-kube-api-access-79ft8\") pod \"kube-storage-version-migrator-operator-799cb7f958-4b9bp\" (UID: \"3cc96dbc-0428-466b-abf1-b79890000d7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" Jul 13 03:00:48.767214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767064 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cc96dbc-0428-466b-abf1-b79890000d7b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-4b9bp\" (UID: \"3cc96dbc-0428-466b-abf1-b79890000d7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" Jul 13 03:00:48.767214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767107 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzbwd\" (UniqueName: \"kubernetes.io/projected/652d8372-f1b2-440e-9282-d1226a028bf9-kube-api-access-rzbwd\") pod \"console-operator-7866497494-5qxrj\" (UID: \"652d8372-f1b2-440e-9282-d1226a028bf9\") " pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.767214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.767703 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-tmp\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.767703 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-snapshots\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.767703 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767309 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-serving-cert\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.767703 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767337 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmvwl\" (UniqueName: \"kubernetes.io/projected/696af790-9f77-4d1e-a284-3f08d039af86-kube-api-access-mmvwl\") pod \"network-check-source-869dcfcdcd-stvgf\" (UID: \"696af790-9f77-4d1e-a284-3f08d039af86\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-stvgf" Jul 13 03:00:48.767703 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767370 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:48.767703 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k46c9\" (UniqueName: \"kubernetes.io/projected/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-kube-api-access-k46c9\") pod \"cluster-samples-operator-65db858894-dkbk6\" (UID: \"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:00:48.767703 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767441 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfrdh\" (UniqueName: \"kubernetes.io/projected/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-kube-api-access-dfrdh\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:48.767703 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767584 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.767981 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.767788 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cc96dbc-0428-466b-abf1-b79890000d7b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-4b9bp\" (UID: \"3cc96dbc-0428-466b-abf1-b79890000d7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" Jul 13 03:00:48.768075 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.768057 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.768196 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.768181 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-tmp\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.768394 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.768370 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-snapshots\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.769563 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.769541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cc96dbc-0428-466b-abf1-b79890000d7b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-4b9bp\" (UID: \"3cc96dbc-0428-466b-abf1-b79890000d7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" Jul 13 03:00:48.770062 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.770045 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-serving-cert\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.774928 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.774896 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9wkt\" (UniqueName: \"kubernetes.io/projected/4a176d83-a5e9-45cf-b5f5-f64d25f4e878-kube-api-access-r9wkt\") pod \"insights-operator-68d9dd94cf-ggnr5\" (UID: \"4a176d83-a5e9-45cf-b5f5-f64d25f4e878\") " pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.775055 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.774950 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79ft8\" (UniqueName: \"kubernetes.io/projected/3cc96dbc-0428-466b-abf1-b79890000d7b-kube-api-access-79ft8\") pod \"kube-storage-version-migrator-operator-799cb7f958-4b9bp\" (UID: \"3cc96dbc-0428-466b-abf1-b79890000d7b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" Jul 13 03:00:48.775419 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.775398 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmvwl\" (UniqueName: \"kubernetes.io/projected/696af790-9f77-4d1e-a284-3f08d039af86-kube-api-access-mmvwl\") pod \"network-check-source-869dcfcdcd-stvgf\" (UID: \"696af790-9f77-4d1e-a284-3f08d039af86\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-stvgf" Jul 13 03:00:48.814378 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.814325 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" Jul 13 03:00:48.824501 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.824471 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" Jul 13 03:00:48.831607 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.831574 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-stvgf" Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.867994 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.868050 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k46c9\" (UniqueName: \"kubernetes.io/projected/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-kube-api-access-k46c9\") pod \"cluster-samples-operator-65db858894-dkbk6\" (UID: \"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.868093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfrdh\" (UniqueName: \"kubernetes.io/projected/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-kube-api-access-dfrdh\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.868166 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dkbk6\" (UID: \"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.868206 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.868232 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/652d8372-f1b2-440e-9282-d1226a028bf9-config\") pod \"console-operator-7866497494-5qxrj\" (UID: \"652d8372-f1b2-440e-9282-d1226a028bf9\") " pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.868257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/652d8372-f1b2-440e-9282-d1226a028bf9-serving-cert\") pod \"console-operator-7866497494-5qxrj\" (UID: \"652d8372-f1b2-440e-9282-d1226a028bf9\") " pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.868281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/652d8372-f1b2-440e-9282-d1226a028bf9-trusted-ca\") pod \"console-operator-7866497494-5qxrj\" (UID: \"652d8372-f1b2-440e-9282-d1226a028bf9\") " pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.868316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzbwd\" (UniqueName: \"kubernetes.io/projected/652d8372-f1b2-440e-9282-d1226a028bf9-kube-api-access-rzbwd\") pod \"console-operator-7866497494-5qxrj\" (UID: \"652d8372-f1b2-440e-9282-d1226a028bf9\") " pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:48.868702 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:48.868780 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls podName:0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:49.368758285 +0000 UTC m=+230.419565237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls") pod "cluster-samples-operator-65db858894-dkbk6" (UID: "0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6") : secret "samples-operator-tls" not found Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:48.868795 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 03:00:48.869617 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:48.868852 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls podName:f4ae5e21-c8cb-4785-9cce-fd191d73cea9 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:49.368834548 +0000 UTC m=+230.419641491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qskgx" (UID: "f4ae5e21-c8cb-4785-9cce-fd191d73cea9") : secret "cluster-monitoring-operator-tls" not found Jul 13 03:00:48.870782 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.869875 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:48.870782 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.870181 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/652d8372-f1b2-440e-9282-d1226a028bf9-config\") pod \"console-operator-7866497494-5qxrj\" (UID: \"652d8372-f1b2-440e-9282-d1226a028bf9\") " pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.871295 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.871270 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/652d8372-f1b2-440e-9282-d1226a028bf9-trusted-ca\") pod \"console-operator-7866497494-5qxrj\" (UID: \"652d8372-f1b2-440e-9282-d1226a028bf9\") " pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.872879 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.872842 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/652d8372-f1b2-440e-9282-d1226a028bf9-serving-cert\") pod \"console-operator-7866497494-5qxrj\" (UID: \"652d8372-f1b2-440e-9282-d1226a028bf9\") " pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.878828 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.878772 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzbwd\" (UniqueName: \"kubernetes.io/projected/652d8372-f1b2-440e-9282-d1226a028bf9-kube-api-access-rzbwd\") pod \"console-operator-7866497494-5qxrj\" (UID: \"652d8372-f1b2-440e-9282-d1226a028bf9\") " pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.879184 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.879117 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k46c9\" (UniqueName: \"kubernetes.io/projected/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-kube-api-access-k46c9\") pod \"cluster-samples-operator-65db858894-dkbk6\" (UID: \"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:00:48.879184 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.879117 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfrdh\" (UniqueName: \"kubernetes.io/projected/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-kube-api-access-dfrdh\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:48.921670 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.921633 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:48.968157 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.968090 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp"] Jul 13 03:00:48.972919 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:00:48.972883 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc96dbc_0428_466b_abf1_b79890000d7b.slice/crio-4ac2ce81edbfe71c2a62aacfcc70555a439ec57fe1ad31891d6d593b5dc4080f WatchSource:0}: Error finding container 4ac2ce81edbfe71c2a62aacfcc70555a439ec57fe1ad31891d6d593b5dc4080f: Status 404 returned error can't find the container with id 4ac2ce81edbfe71c2a62aacfcc70555a439ec57fe1ad31891d6d593b5dc4080f Jul 13 03:00:48.988020 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:48.987915 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-ggnr5"] Jul 13 03:00:48.991609 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:00:48.991572 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a176d83_a5e9_45cf_b5f5_f64d25f4e878.slice/crio-e5be91ba16ac44df7827d8d283af1ba029394f47aca7cbaf885fa7475a06a60b WatchSource:0}: Error finding container e5be91ba16ac44df7827d8d283af1ba029394f47aca7cbaf885fa7475a06a60b: Status 404 returned error can't find the container with id e5be91ba16ac44df7827d8d283af1ba029394f47aca7cbaf885fa7475a06a60b Jul 13 03:00:49.009041 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:49.009002 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-stvgf"] Jul 13 03:00:49.014520 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:00:49.014482 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod696af790_9f77_4d1e_a284_3f08d039af86.slice/crio-a7373d79db25080a04672c081d6874c477d8176061ecacb893d937de3fe04030 WatchSource:0}: Error finding container a7373d79db25080a04672c081d6874c477d8176061ecacb893d937de3fe04030: Status 404 returned error can't find the container with id a7373d79db25080a04672c081d6874c477d8176061ecacb893d937de3fe04030 Jul 13 03:00:49.071740 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:49.071709 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-5qxrj"] Jul 13 03:00:49.075613 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:00:49.075580 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652d8372_f1b2_440e_9282_d1226a028bf9.slice/crio-b9b233adcb1188b148baab8494bf5fe1dc8255facb4ff8df73595b3d3978b553 WatchSource:0}: Error finding container b9b233adcb1188b148baab8494bf5fe1dc8255facb4ff8df73595b3d3978b553: Status 404 returned error can't find the container with id b9b233adcb1188b148baab8494bf5fe1dc8255facb4ff8df73595b3d3978b553 Jul 13 03:00:49.332326 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:49.332218 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5qxrj" event={"ID":"652d8372-f1b2-440e-9282-d1226a028bf9","Type":"ContainerStarted","Data":"b9b233adcb1188b148baab8494bf5fe1dc8255facb4ff8df73595b3d3978b553"} Jul 13 03:00:49.333717 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:49.333687 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-stvgf" event={"ID":"696af790-9f77-4d1e-a284-3f08d039af86","Type":"ContainerStarted","Data":"8b65dd0af9bd16f2427e2bc70592b4a644727bd6b9ff07e0c0fd924a63dc6f9f"} Jul 13 03:00:49.333862 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:49.333738 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-stvgf" event={"ID":"696af790-9f77-4d1e-a284-3f08d039af86","Type":"ContainerStarted","Data":"a7373d79db25080a04672c081d6874c477d8176061ecacb893d937de3fe04030"} Jul 13 03:00:49.334915 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:49.334893 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" event={"ID":"3cc96dbc-0428-466b-abf1-b79890000d7b","Type":"ContainerStarted","Data":"4ac2ce81edbfe71c2a62aacfcc70555a439ec57fe1ad31891d6d593b5dc4080f"} Jul 13 03:00:49.335988 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:49.335970 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" event={"ID":"4a176d83-a5e9-45cf-b5f5-f64d25f4e878","Type":"ContainerStarted","Data":"e5be91ba16ac44df7827d8d283af1ba029394f47aca7cbaf885fa7475a06a60b"} Jul 13 03:00:49.348961 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:49.348912 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-stvgf" podStartSLOduration=1.348895201 podStartE2EDuration="1.348895201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:00:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:00:49.347650416 +0000 UTC m=+230.398457373" watchObservedRunningTime="2026-07-13 03:00:49.348895201 +0000 UTC m=+230.399702136" Jul 13 03:00:49.372959 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:49.372919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:49.373187 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:49.373041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dkbk6\" (UID: \"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:00:49.373187 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:49.373072 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 03:00:49.373187 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:49.373157 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls podName:f4ae5e21-c8cb-4785-9cce-fd191d73cea9 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:50.373123528 +0000 UTC m=+231.423930463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qskgx" (UID: "f4ae5e21-c8cb-4785-9cce-fd191d73cea9") : secret "cluster-monitoring-operator-tls" not found Jul 13 03:00:49.373187 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:49.373175 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 03:00:49.373372 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:49.373234 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls podName:0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:50.37321627 +0000 UTC m=+231.424023208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls") pod "cluster-samples-operator-65db858894-dkbk6" (UID: "0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6") : secret "samples-operator-tls" not found Jul 13 03:00:50.381493 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:50.381438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dkbk6\" (UID: \"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:00:50.381944 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:50.381500 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:50.381944 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:50.381633 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 03:00:50.381944 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:50.381714 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls podName:f4ae5e21-c8cb-4785-9cce-fd191d73cea9 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:52.381692432 +0000 UTC m=+233.432499370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qskgx" (UID: "f4ae5e21-c8cb-4785-9cce-fd191d73cea9") : secret "cluster-monitoring-operator-tls" not found Jul 13 03:00:50.381944 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:50.381633 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 03:00:50.381944 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:50.381797 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls podName:0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:52.381778533 +0000 UTC m=+233.432585479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls") pod "cluster-samples-operator-65db858894-dkbk6" (UID: "0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6") : secret "samples-operator-tls" not found Jul 13 03:00:52.347465 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:52.347422 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" event={"ID":"3cc96dbc-0428-466b-abf1-b79890000d7b","Type":"ContainerStarted","Data":"77eb32442aaa8d2a5cb2103d783368f7f8a534e5e2283dc7ecb9b6c3b0537da6"} Jul 13 03:00:52.349162 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:52.349101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" event={"ID":"4a176d83-a5e9-45cf-b5f5-f64d25f4e878","Type":"ContainerStarted","Data":"f2bfa9777e83539e7b4c60a4f416bd8ff5f575e869006f87e4e8de9971a922a1"} Jul 13 03:00:52.363804 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:52.363737 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" podStartSLOduration=1.797299397 podStartE2EDuration="4.363717674s" totalImagesPullingTime="2.566418277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:00:52.363234844 +0000 UTC m=+233.414041800" watchObservedRunningTime="2026-07-13 03:00:52.363717674 +0000 UTC m=+233.414524632" Jul 13 03:00:52.380885 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:52.380821 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" podStartSLOduration=1.841307399 podStartE2EDuration="4.380797011s" totalImagesPullingTime="2.539489612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:00:52.380509867 +0000 UTC m=+233.431316827" watchObservedRunningTime="2026-07-13 03:00:52.380797011 +0000 UTC m=+233.431603949" Jul 13 03:00:52.397026 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:52.396983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:52.397229 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:52.397116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dkbk6\" (UID: \"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:00:52.397229 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:52.397171 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 03:00:52.397340 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:52.397248 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 03:00:52.397340 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:52.397259 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls podName:f4ae5e21-c8cb-4785-9cce-fd191d73cea9 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:56.397237368 +0000 UTC m=+237.448044304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qskgx" (UID: "f4ae5e21-c8cb-4785-9cce-fd191d73cea9") : secret "cluster-monitoring-operator-tls" not found Jul 13 03:00:52.397340 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:52.397310 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls podName:0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:56.397291649 +0000 UTC m=+237.448098599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls") pod "cluster-samples-operator-65db858894-dkbk6" (UID: "0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6") : secret "samples-operator-tls" not found Jul 13 03:00:53.355521 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:53.355484 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5qxrj" event={"ID":"652d8372-f1b2-440e-9282-d1226a028bf9","Type":"ContainerStarted","Data":"8ebc6687c3909946ef739038a93a379d30bd67080a6ee3036a87307f974f60af"} Jul 13 03:00:53.355995 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:53.355955 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:53.357454 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:53.357424 2563 patch_prober.go:28] interesting pod/console-operator-7866497494-5qxrj container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.12:8443/readyz\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jul 13 03:00:53.357603 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:53.357474 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-5qxrj" podUID="652d8372-f1b2-440e-9282-d1226a028bf9" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.12:8443/readyz\": dial tcp 10.134.0.12:8443: connect: connection refused" Jul 13 03:00:53.378113 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:53.378067 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-5qxrj" podStartSLOduration=1.219473054 podStartE2EDuration="5.378048038s" totalImagesPullingTime="4.158574984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:00:53.377420979 +0000 UTC m=+234.428227939" watchObservedRunningTime="2026-07-13 03:00:53.378048038 +0000 UTC m=+234.428854994" Jul 13 03:00:53.876014 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:53.875976 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-njnf7"] Jul 13 03:00:53.879278 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:53.879245 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:53.881845 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:53.881796 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7mbnd\"" Jul 13 03:00:53.881845 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:53.881799 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 03:00:53.882724 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:53.882701 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 03:00:53.890394 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:53.890366 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-njnf7"] Jul 13 03:00:54.012993 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.012946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40eba173-65f6-4b4a-a198-d6781b5e12f6-data-volume\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.013202 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.013009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.013202 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.013075 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqhv2\" (UniqueName: \"kubernetes.io/projected/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-api-access-xqhv2\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.013202 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.013161 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40eba173-65f6-4b4a-a198-d6781b5e12f6-crio-socket\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.013312 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.013202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.114506 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.114468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40eba173-65f6-4b4a-a198-d6781b5e12f6-data-volume\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.114691 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.114519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.114691 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.114539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqhv2\" (UniqueName: \"kubernetes.io/projected/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-api-access-xqhv2\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.114691 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:54.114668 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:00:54.114820 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:54.114741 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls podName:40eba173-65f6-4b4a-a198-d6781b5e12f6 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:54.614718852 +0000 UTC m=+235.665525789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-njnf7" (UID: "40eba173-65f6-4b4a-a198-d6781b5e12f6") : secret "insights-runtime-extractor-tls" not found Jul 13 03:00:54.114820 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.114798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40eba173-65f6-4b4a-a198-d6781b5e12f6-crio-socket\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.114920 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.114850 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.114920 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.114911 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40eba173-65f6-4b4a-a198-d6781b5e12f6-data-volume\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.115021 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.114929 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40eba173-65f6-4b4a-a198-d6781b5e12f6-crio-socket\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.115021 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:54.114949 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:00:54.115021 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:54.115016 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm podName:40eba173-65f6-4b4a-a198-d6781b5e12f6 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:54.614996972 +0000 UTC m=+235.665803926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-njnf7" (UID: "40eba173-65f6-4b4a-a198-d6781b5e12f6") : configmap "kube-rbac-proxy" not found Jul 13 03:00:54.127202 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.127112 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqhv2\" (UniqueName: \"kubernetes.io/projected/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-api-access-xqhv2\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.181388 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.181343 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2lf2m"] Jul 13 03:00:54.185068 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.185042 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2lf2m" Jul 13 03:00:54.187693 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.187660 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 13 03:00:54.189372 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.189340 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 13 03:00:54.189372 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.189346 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7w5fz\"" Jul 13 03:00:54.193494 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.193422 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2lf2m"] Jul 13 03:00:54.316868 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.316822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgcwj\" (UniqueName: \"kubernetes.io/projected/d29cc68e-2daa-454d-8ed9-c91d0d2c20f1-kube-api-access-bgcwj\") pod \"migrator-7f59b54f6c-2lf2m\" (UID: \"d29cc68e-2daa-454d-8ed9-c91d0d2c20f1\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2lf2m" Jul 13 03:00:54.359356 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.359322 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/0.log" Jul 13 03:00:54.359845 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.359366 2563 generic.go:356] "Generic (PLEG): container finished" podID="652d8372-f1b2-440e-9282-d1226a028bf9" containerID="8ebc6687c3909946ef739038a93a379d30bd67080a6ee3036a87307f974f60af" exitCode=255 Jul 13 03:00:54.359845 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.359436 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5qxrj" event={"ID":"652d8372-f1b2-440e-9282-d1226a028bf9","Type":"ContainerDied","Data":"8ebc6687c3909946ef739038a93a379d30bd67080a6ee3036a87307f974f60af"} Jul 13 03:00:54.359845 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.359728 2563 scope.go:117] "RemoveContainer" containerID="8ebc6687c3909946ef739038a93a379d30bd67080a6ee3036a87307f974f60af" Jul 13 03:00:54.417928 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.417904 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgcwj\" (UniqueName: \"kubernetes.io/projected/d29cc68e-2daa-454d-8ed9-c91d0d2c20f1-kube-api-access-bgcwj\") pod \"migrator-7f59b54f6c-2lf2m\" (UID: \"d29cc68e-2daa-454d-8ed9-c91d0d2c20f1\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2lf2m" Jul 13 03:00:54.425500 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.425472 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgcwj\" (UniqueName: \"kubernetes.io/projected/d29cc68e-2daa-454d-8ed9-c91d0d2c20f1-kube-api-access-bgcwj\") pod \"migrator-7f59b54f6c-2lf2m\" (UID: \"d29cc68e-2daa-454d-8ed9-c91d0d2c20f1\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2lf2m" Jul 13 03:00:54.495928 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.495889 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2lf2m" Jul 13 03:00:54.619927 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.619891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.620118 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.619995 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:54.620118 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:54.620063 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:00:54.620243 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:54.620118 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:00:54.620243 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:54.620169 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls podName:40eba173-65f6-4b4a-a198-d6781b5e12f6 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:55.620127668 +0000 UTC m=+236.670934603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-njnf7" (UID: "40eba173-65f6-4b4a-a198-d6781b5e12f6") : secret "insights-runtime-extractor-tls" not found Jul 13 03:00:54.620243 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:54.620187 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm podName:40eba173-65f6-4b4a-a198-d6781b5e12f6 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:55.620179036 +0000 UTC m=+236.670985971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-njnf7" (UID: "40eba173-65f6-4b4a-a198-d6781b5e12f6") : configmap "kube-rbac-proxy" not found Jul 13 03:00:54.627908 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:54.627876 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2lf2m"] Jul 13 03:00:54.632030 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:00:54.631991 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd29cc68e_2daa_454d_8ed9_c91d0d2c20f1.slice/crio-210e7b96cff58f61f9ee02f7434a31f993f1a11575dc7cd67e2248a1109193f6 WatchSource:0}: Error finding container 210e7b96cff58f61f9ee02f7434a31f993f1a11575dc7cd67e2248a1109193f6: Status 404 returned error can't find the container with id 210e7b96cff58f61f9ee02f7434a31f993f1a11575dc7cd67e2248a1109193f6 Jul 13 03:00:55.363749 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:55.363712 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2lf2m" event={"ID":"d29cc68e-2daa-454d-8ed9-c91d0d2c20f1","Type":"ContainerStarted","Data":"210e7b96cff58f61f9ee02f7434a31f993f1a11575dc7cd67e2248a1109193f6"} Jul 13 03:00:55.365180 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:55.365163 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:00:55.365599 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:55.365582 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/0.log" Jul 13 03:00:55.365657 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:55.365620 2563 generic.go:356] "Generic (PLEG): container finished" podID="652d8372-f1b2-440e-9282-d1226a028bf9" containerID="607cc4f19870deaa67c36bca2c4a0f0848e043f7ea9c38f164877cd500e60c2a" exitCode=255 Jul 13 03:00:55.365657 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:55.365649 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5qxrj" event={"ID":"652d8372-f1b2-440e-9282-d1226a028bf9","Type":"ContainerDied","Data":"607cc4f19870deaa67c36bca2c4a0f0848e043f7ea9c38f164877cd500e60c2a"} Jul 13 03:00:55.365748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:55.365699 2563 scope.go:117] "RemoveContainer" containerID="8ebc6687c3909946ef739038a93a379d30bd67080a6ee3036a87307f974f60af" Jul 13 03:00:55.366008 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:55.365983 2563 scope.go:117] "RemoveContainer" containerID="607cc4f19870deaa67c36bca2c4a0f0848e043f7ea9c38f164877cd500e60c2a" Jul 13 03:00:55.366195 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:55.366169 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5qxrj_openshift-console-operator(652d8372-f1b2-440e-9282-d1226a028bf9)\"" pod="openshift-console-operator/console-operator-7866497494-5qxrj" podUID="652d8372-f1b2-440e-9282-d1226a028bf9" Jul 13 03:00:55.628727 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:55.628631 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:55.628902 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:55.628733 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:00:55.628902 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:55.628779 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:55.628902 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:55.628811 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm podName:40eba173-65f6-4b4a-a198-d6781b5e12f6 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:57.6287881 +0000 UTC m=+238.679595054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-njnf7" (UID: "40eba173-65f6-4b4a-a198-d6781b5e12f6") : configmap "kube-rbac-proxy" not found Jul 13 03:00:55.628902 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:55.628861 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:00:55.629105 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:55.628914 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls podName:40eba173-65f6-4b4a-a198-d6781b5e12f6 nodeName:}" failed. No retries permitted until 2026-07-13 03:00:57.628897443 +0000 UTC m=+238.679704380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-njnf7" (UID: "40eba173-65f6-4b4a-a198-d6781b5e12f6") : secret "insights-runtime-extractor-tls" not found Jul 13 03:00:55.770200 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:55.770173 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8cqcw_7359c1d2-d166-472c-b46e-c1ed274b850f/dns-node-resolver/0.log" Jul 13 03:00:56.370488 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:56.370459 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:00:56.370915 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:56.370815 2563 scope.go:117] "RemoveContainer" containerID="607cc4f19870deaa67c36bca2c4a0f0848e043f7ea9c38f164877cd500e60c2a" Jul 13 03:00:56.371042 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:56.371013 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5qxrj_openshift-console-operator(652d8372-f1b2-440e-9282-d1226a028bf9)\"" pod="openshift-console-operator/console-operator-7866497494-5qxrj" podUID="652d8372-f1b2-440e-9282-d1226a028bf9" Jul 13 03:00:56.372604 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:56.372581 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2lf2m" event={"ID":"d29cc68e-2daa-454d-8ed9-c91d0d2c20f1","Type":"ContainerStarted","Data":"80cd5b57dd921a33c934b86465e4dfb1ef5525ab4887e78e79d3a24a2a8c4fdb"} Jul 13 03:00:56.372702 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:56.372624 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2lf2m" event={"ID":"d29cc68e-2daa-454d-8ed9-c91d0d2c20f1","Type":"ContainerStarted","Data":"c998c83a9d80cbc9c30c8ed1244d32d72733dd3d21ddc19873e84f89330d8704"} Jul 13 03:00:56.404168 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:56.404080 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2lf2m" podStartSLOduration=0.864396749 podStartE2EDuration="2.404062443s" totalImagesPullingTime="1.539665694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:00:56.403623269 +0000 UTC m=+237.454430227" watchObservedRunningTime="2026-07-13 03:00:56.404062443 +0000 UTC m=+237.454869400" Jul 13 03:00:56.436391 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:56.436288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:00:56.436391 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:56.436357 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dkbk6\" (UID: \"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:00:56.436570 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:56.436453 2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 13 03:00:56.436570 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:56.436520 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls podName:f4ae5e21-c8cb-4785-9cce-fd191d73cea9 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:04.4365028 +0000 UTC m=+245.487309736 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-qskgx" (UID: "f4ae5e21-c8cb-4785-9cce-fd191d73cea9") : secret "cluster-monitoring-operator-tls" not found Jul 13 03:00:56.436570 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:56.436459 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 13 03:00:56.436677 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:56.436599 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls podName:0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:04.436586663 +0000 UTC m=+245.487393598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls") pod "cluster-samples-operator-65db858894-dkbk6" (UID: "0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6") : secret "samples-operator-tls" not found Jul 13 03:00:56.969661 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:56.969629 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pqxkj_d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d/node-ca/0.log" Jul 13 03:00:57.569307 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:57.569264 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7rlxp_bbba74a8-4ac0-48db-8236-d8951b76f810/serve-healthcheck-canary/0.log" Jul 13 03:00:57.645793 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:57.645730 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:57.645987 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:57.645826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:00:57.645987 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:57.645876 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 03:00:57.645987 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:57.645952 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:00:57.645987 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:57.645959 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm podName:40eba173-65f6-4b4a-a198-d6781b5e12f6 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:01.645940811 +0000 UTC m=+242.696747754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-njnf7" (UID: "40eba173-65f6-4b4a-a198-d6781b5e12f6") : configmap "kube-rbac-proxy" not found Jul 13 03:00:57.646174 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:57.645991 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls podName:40eba173-65f6-4b4a-a198-d6781b5e12f6 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:01.645980122 +0000 UTC m=+242.696787056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-njnf7" (UID: "40eba173-65f6-4b4a-a198-d6781b5e12f6") : secret "insights-runtime-extractor-tls" not found Jul 13 03:00:58.922940 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:58.922845 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:00:58.923331 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:00:58.923264 2563 scope.go:117] "RemoveContainer" containerID="607cc4f19870deaa67c36bca2c4a0f0848e043f7ea9c38f164877cd500e60c2a" Jul 13 03:00:58.923435 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:00:58.923415 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5qxrj_openshift-console-operator(652d8372-f1b2-440e-9282-d1226a028bf9)\"" pod="openshift-console-operator/console-operator-7866497494-5qxrj" podUID="652d8372-f1b2-440e-9282-d1226a028bf9" Jul 13 03:01:01.679176 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:01.679096 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:01:01.679580 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:01.679227 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:01:01.679580 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:01:01.679371 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 03:01:01.679580 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:01:01.679443 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls podName:40eba173-65f6-4b4a-a198-d6781b5e12f6 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:09.679424589 +0000 UTC m=+250.730231523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-njnf7" (UID: "40eba173-65f6-4b4a-a198-d6781b5e12f6") : secret "insights-runtime-extractor-tls" not found Jul 13 03:01:01.679725 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:01.679698 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40eba173-65f6-4b4a-a198-d6781b5e12f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:01:03.356279 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:03.356221 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:01:03.356790 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:03.356748 2563 scope.go:117] "RemoveContainer" containerID="607cc4f19870deaa67c36bca2c4a0f0848e043f7ea9c38f164877cd500e60c2a" Jul 13 03:01:03.356974 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:01:03.356946 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-5qxrj_openshift-console-operator(652d8372-f1b2-440e-9282-d1226a028bf9)\"" pod="openshift-console-operator/console-operator-7866497494-5qxrj" podUID="652d8372-f1b2-440e-9282-d1226a028bf9" Jul 13 03:01:04.500486 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:04.500447 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dkbk6\" (UID: \"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:01:04.500928 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:04.500562 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:01:04.503162 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:04.503116 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4ae5e21-c8cb-4785-9cce-fd191d73cea9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-qskgx\" (UID: \"f4ae5e21-c8cb-4785-9cce-fd191d73cea9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:01:04.503286 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:04.503250 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dkbk6\" (UID: \"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:01:04.515529 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:04.515496 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bk8xk\"" Jul 13 03:01:04.523625 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:04.523601 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" Jul 13 03:01:04.529849 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:04.529820 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gq7mw\"" Jul 13 03:01:04.538082 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:04.538054 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" Jul 13 03:01:04.677435 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:04.677401 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx"] Jul 13 03:01:04.680593 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:01:04.680562 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ae5e21_c8cb_4785_9cce_fd191d73cea9.slice/crio-c49145c22d4292e2f671858ec97e7a3a25d97577cdd2b25bc18212ff2128b924 WatchSource:0}: Error finding container c49145c22d4292e2f671858ec97e7a3a25d97577cdd2b25bc18212ff2128b924: Status 404 returned error can't find the container with id c49145c22d4292e2f671858ec97e7a3a25d97577cdd2b25bc18212ff2128b924 Jul 13 03:01:04.693826 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:04.693793 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6"] Jul 13 03:01:05.402085 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:05.402045 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" event={"ID":"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6","Type":"ContainerStarted","Data":"4e464d06c776aa8d69cded54a215dbd74ececb0dd3cca8bcbb54d5880262a160"} Jul 13 03:01:05.403312 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:05.403279 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" event={"ID":"f4ae5e21-c8cb-4785-9cce-fd191d73cea9","Type":"ContainerStarted","Data":"c49145c22d4292e2f671858ec97e7a3a25d97577cdd2b25bc18212ff2128b924"} Jul 13 03:01:07.412880 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:07.412835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" event={"ID":"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6","Type":"ContainerStarted","Data":"0667302e8bdab2ad35a452c69cc8aab6e3b5ded0c2b75af06a1edd00f5577d71"} Jul 13 03:01:07.414833 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:07.414805 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" event={"ID":"f4ae5e21-c8cb-4785-9cce-fd191d73cea9","Type":"ContainerStarted","Data":"cf87e25f3711248bc9c83a8d3c305ba42afe4b5e19442f9a0135745888dc3a8a"} Jul 13 03:01:07.434613 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:07.434557 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-qskgx" podStartSLOduration=16.802564025 podStartE2EDuration="19.43453539s" totalImagesPullingTime="2.631971365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:07.433290186 +0000 UTC m=+248.484097144" watchObservedRunningTime="2026-07-13 03:01:07.43453539 +0000 UTC m=+248.485342346" Jul 13 03:01:08.420018 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:08.419982 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" event={"ID":"0a89cbf4-4b0d-4b09-9078-3c6d8bf11de6","Type":"ContainerStarted","Data":"552604e92252e95f1574aa2f6a03344a32813495af4988451eceb656525adfa1"} Jul 13 03:01:09.748546 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:09.748508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:01:09.751026 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:09.750988 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40eba173-65f6-4b4a-a198-d6781b5e12f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-njnf7\" (UID: \"40eba173-65f6-4b4a-a198-d6781b5e12f6\") " pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:01:09.792254 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:09.792221 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7mbnd\"" Jul 13 03:01:09.799972 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:09.799941 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-njnf7" Jul 13 03:01:09.935221 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:09.935134 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dkbk6" podStartSLOduration=19.357044039 podStartE2EDuration="21.935115271s" totalImagesPullingTime="2.578071232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:08.439343179 +0000 UTC m=+249.490150136" watchObservedRunningTime="2026-07-13 03:01:09.935115271 +0000 UTC m=+250.985922296" Jul 13 03:01:09.935899 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:09.935879 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-njnf7"] Jul 13 03:01:09.939073 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:01:09.939044 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40eba173_65f6_4b4a_a198_d6781b5e12f6.slice/crio-32aff414d81439acbdb1eae13a231d340f9b12f3af45510711f4e46f18f3a1bc WatchSource:0}: Error finding container 32aff414d81439acbdb1eae13a231d340f9b12f3af45510711f4e46f18f3a1bc: Status 404 returned error can't find the container with id 32aff414d81439acbdb1eae13a231d340f9b12f3af45510711f4e46f18f3a1bc Jul 13 03:01:10.429130 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:10.429095 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-njnf7" event={"ID":"40eba173-65f6-4b4a-a198-d6781b5e12f6","Type":"ContainerStarted","Data":"32aff414d81439acbdb1eae13a231d340f9b12f3af45510711f4e46f18f3a1bc"} Jul 13 03:01:11.361503 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:11.361456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 03:01:11.364338 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:11.364310 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/03bd910c-0e0d-4afd-882a-9510de44edfd-metrics-certs\") pod \"network-metrics-daemon-nk7sp\" (UID: \"03bd910c-0e0d-4afd-882a-9510de44edfd\") " pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 03:01:11.565659 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:11.565624 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8nlv8\"" Jul 13 03:01:11.573116 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:11.573078 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nk7sp" Jul 13 03:01:11.721255 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:11.721217 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nk7sp"] Jul 13 03:01:13.523551 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:01:13.523508 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03bd910c_0e0d_4afd_882a_9510de44edfd.slice/crio-91fc2feac7b0575314c02c8bc0af3e08ef23df7aa5a0d454fcd8986efcafe197 WatchSource:0}: Error finding container 91fc2feac7b0575314c02c8bc0af3e08ef23df7aa5a0d454fcd8986efcafe197: Status 404 returned error can't find the container with id 91fc2feac7b0575314c02c8bc0af3e08ef23df7aa5a0d454fcd8986efcafe197 Jul 13 03:01:14.445920 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:14.445880 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nk7sp" event={"ID":"03bd910c-0e0d-4afd-882a-9510de44edfd","Type":"ContainerStarted","Data":"91fc2feac7b0575314c02c8bc0af3e08ef23df7aa5a0d454fcd8986efcafe197"} Jul 13 03:01:14.447582 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:14.447548 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-njnf7" event={"ID":"40eba173-65f6-4b4a-a198-d6781b5e12f6","Type":"ContainerStarted","Data":"89a0fc58c374234329447c70496a96cedef2db709a6643aeae2bb6464e7001d2"} Jul 13 03:01:14.463499 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:14.463458 2563 scope.go:117] "RemoveContainer" containerID="607cc4f19870deaa67c36bca2c4a0f0848e043f7ea9c38f164877cd500e60c2a" Jul 13 03:01:15.454020 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.453981 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nk7sp" event={"ID":"03bd910c-0e0d-4afd-882a-9510de44edfd","Type":"ContainerStarted","Data":"898046250ecdf37a539b0845749dcfd954706ad0b200596f025cee7f2d2763b4"} Jul 13 03:01:15.454523 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.454047 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nk7sp" event={"ID":"03bd910c-0e0d-4afd-882a-9510de44edfd","Type":"ContainerStarted","Data":"8ac76ac2c0030f17aa74f58a5f0adcf398886072f3c248e3cd22771e7c858b25"} Jul 13 03:01:15.456209 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.456170 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-njnf7" event={"ID":"40eba173-65f6-4b4a-a198-d6781b5e12f6","Type":"ContainerStarted","Data":"9e2c62b3899555d48298526f5b2b654f5216749c240202ee04203a141afecb36"} Jul 13 03:01:15.458703 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.458677 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:01:15.458814 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.458745 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-5qxrj" event={"ID":"652d8372-f1b2-440e-9282-d1226a028bf9","Type":"ContainerStarted","Data":"df500dc3705980d196aa71a9970d483642b0297430a09cb2563dba532d9647a8"} Jul 13 03:01:15.459058 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.459030 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:01:15.468335 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.468301 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-5qxrj" Jul 13 03:01:15.491239 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.491172 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nk7sp" podStartSLOduration=255.485512191 podStartE2EDuration="4m16.491121622s" totalImagesPullingTime="1.005609431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:15.488761828 +0000 UTC m=+256.539568786" watchObservedRunningTime="2026-07-13 03:01:15.491121622 +0000 UTC m=+256.541928580" Jul 13 03:01:15.508651 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.508581 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67"] Jul 13 03:01:15.513529 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.513453 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67" Jul 13 03:01:15.517441 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.517413 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-66682\"" Jul 13 03:01:15.517735 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.517712 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 13 03:01:15.541048 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.540991 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-2w2qq"] Jul 13 03:01:15.544519 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.544396 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67"] Jul 13 03:01:15.544519 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.544518 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-2w2qq" Jul 13 03:01:15.549852 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.549827 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-szf9q\"" Jul 13 03:01:15.550255 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.550232 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 03:01:15.551778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.551726 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 03:01:15.585235 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.585122 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-2w2qq"] Jul 13 03:01:15.595773 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.595735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10fa53a3-7506-4b99-8786-4c6bafb06ad8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-zcm67\" (UID: \"10fa53a3-7506-4b99-8786-4c6bafb06ad8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67" Jul 13 03:01:15.595939 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.595832 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kh2v\" (UniqueName: \"kubernetes.io/projected/c6907df4-7a1d-4a0b-8d71-df1fa6b70e91-kube-api-access-2kh2v\") pod \"downloads-68c9cbb497-2w2qq\" (UID: \"c6907df4-7a1d-4a0b-8d71-df1fa6b70e91\") " pod="openshift-console/downloads-68c9cbb497-2w2qq" Jul 13 03:01:15.613867 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.613835 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-859795f5db-lrfbd"] Jul 13 03:01:15.617252 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.617218 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.620738 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.620707 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jtncw\"" Jul 13 03:01:15.620878 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.620765 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 03:01:15.621910 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.621878 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 03:01:15.622033 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.621964 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 03:01:15.630538 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.630503 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 03:01:15.638470 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.638433 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-859795f5db-lrfbd"] Jul 13 03:01:15.696956 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.696914 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kh2v\" (UniqueName: \"kubernetes.io/projected/c6907df4-7a1d-4a0b-8d71-df1fa6b70e91-kube-api-access-2kh2v\") pod \"downloads-68c9cbb497-2w2qq\" (UID: \"c6907df4-7a1d-4a0b-8d71-df1fa6b70e91\") " pod="openshift-console/downloads-68c9cbb497-2w2qq" Jul 13 03:01:15.697180 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.696967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-installation-pull-secrets\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.697180 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.696996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-image-registry-private-configuration\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.697180 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.697032 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-bound-sa-token\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.697180 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.697056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-registry-tls\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.697180 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.697077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhtmk\" (UniqueName: \"kubernetes.io/projected/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-kube-api-access-rhtmk\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.697481 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.697208 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-ca-trust-extracted\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.697481 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.697280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-registry-certificates\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.697481 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.697306 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-trusted-ca\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.697481 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.697372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10fa53a3-7506-4b99-8786-4c6bafb06ad8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-zcm67\" (UID: \"10fa53a3-7506-4b99-8786-4c6bafb06ad8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67" Jul 13 03:01:15.700479 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.700448 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10fa53a3-7506-4b99-8786-4c6bafb06ad8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-zcm67\" (UID: \"10fa53a3-7506-4b99-8786-4c6bafb06ad8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67" Jul 13 03:01:15.718594 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.718518 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kh2v\" (UniqueName: \"kubernetes.io/projected/c6907df4-7a1d-4a0b-8d71-df1fa6b70e91-kube-api-access-2kh2v\") pod \"downloads-68c9cbb497-2w2qq\" (UID: \"c6907df4-7a1d-4a0b-8d71-df1fa6b70e91\") " pod="openshift-console/downloads-68c9cbb497-2w2qq" Jul 13 03:01:15.798635 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.798588 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-registry-certificates\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.798635 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.798640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-trusted-ca\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.798898 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.798692 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-installation-pull-secrets\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.798898 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.798710 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-image-registry-private-configuration\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.798898 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.798738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-bound-sa-token\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.798898 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.798764 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-registry-tls\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.798898 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.798787 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhtmk\" (UniqueName: \"kubernetes.io/projected/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-kube-api-access-rhtmk\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.798898 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.798826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-ca-trust-extracted\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.799616 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.799583 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-ca-trust-extracted\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.799745 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.799697 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-registry-certificates\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.799842 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.799768 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-trusted-ca\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.802160 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.802112 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-installation-pull-secrets\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.802638 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.802614 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-image-registry-private-configuration\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.802842 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.802820 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-registry-tls\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.812327 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.812293 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-bound-sa-token\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.812560 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.812507 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhtmk\" (UniqueName: \"kubernetes.io/projected/34f4c7ae-77d4-4b08-84d0-8530bfa10f1b-kube-api-access-rhtmk\") pod \"image-registry-859795f5db-lrfbd\" (UID: \"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b\") " pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:15.825230 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.825191 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67" Jul 13 03:01:15.856031 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.855992 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-2w2qq" Jul 13 03:01:15.933540 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:15.932972 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:16.003487 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:16.003319 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67"] Jul 13 03:01:16.008490 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:01:16.008453 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fa53a3_7506_4b99_8786_4c6bafb06ad8.slice/crio-d49b0874b421ff455519641a3ffd3e0e041448a1bd288fe9afe34f3d502661b5 WatchSource:0}: Error finding container d49b0874b421ff455519641a3ffd3e0e041448a1bd288fe9afe34f3d502661b5: Status 404 returned error can't find the container with id d49b0874b421ff455519641a3ffd3e0e041448a1bd288fe9afe34f3d502661b5 Jul 13 03:01:16.038349 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:16.038165 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-2w2qq"] Jul 13 03:01:16.041466 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:01:16.041397 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6907df4_7a1d_4a0b_8d71_df1fa6b70e91.slice/crio-fe12a2a2432a813a562e7eee5c615bd8a87a191a3ec421aa602713cbd4e96c7b WatchSource:0}: Error finding container fe12a2a2432a813a562e7eee5c615bd8a87a191a3ec421aa602713cbd4e96c7b: Status 404 returned error can't find the container with id fe12a2a2432a813a562e7eee5c615bd8a87a191a3ec421aa602713cbd4e96c7b Jul 13 03:01:16.113820 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:16.113784 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-859795f5db-lrfbd"] Jul 13 03:01:16.116253 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:01:16.116217 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f4c7ae_77d4_4b08_84d0_8530bfa10f1b.slice/crio-47dc42dc374ace0bf830261d8b53046691fbbc70d17724a341880459f4b267e2 WatchSource:0}: Error finding container 47dc42dc374ace0bf830261d8b53046691fbbc70d17724a341880459f4b267e2: Status 404 returned error can't find the container with id 47dc42dc374ace0bf830261d8b53046691fbbc70d17724a341880459f4b267e2 Jul 13 03:01:16.465121 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:16.465065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67" event={"ID":"10fa53a3-7506-4b99-8786-4c6bafb06ad8","Type":"ContainerStarted","Data":"d49b0874b421ff455519641a3ffd3e0e041448a1bd288fe9afe34f3d502661b5"} Jul 13 03:01:16.466878 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:16.466837 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-859795f5db-lrfbd" event={"ID":"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b","Type":"ContainerStarted","Data":"037c4df2c3922d23777225e2b3ca1f1264f6dbda26a20aeba22068d66edae525"} Jul 13 03:01:16.467013 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:16.466905 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-859795f5db-lrfbd" event={"ID":"34f4c7ae-77d4-4b08-84d0-8530bfa10f1b","Type":"ContainerStarted","Data":"47dc42dc374ace0bf830261d8b53046691fbbc70d17724a341880459f4b267e2"} Jul 13 03:01:16.467374 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:16.467352 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:16.468782 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:16.468753 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-2w2qq" event={"ID":"c6907df4-7a1d-4a0b-8d71-df1fa6b70e91","Type":"ContainerStarted","Data":"fe12a2a2432a813a562e7eee5c615bd8a87a191a3ec421aa602713cbd4e96c7b"} Jul 13 03:01:16.486685 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:16.486613 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-859795f5db-lrfbd" podStartSLOduration=1.486589175 podStartE2EDuration="1.486589175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:16.486360636 +0000 UTC m=+257.537167598" watchObservedRunningTime="2026-07-13 03:01:16.486589175 +0000 UTC m=+257.537396134" Jul 13 03:01:18.478528 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:18.478485 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67" event={"ID":"10fa53a3-7506-4b99-8786-4c6bafb06ad8","Type":"ContainerStarted","Data":"5acf65a47fc2e10c4491babc3dac4eee9125ffcefb086773ec78e86ed499ea9e"} Jul 13 03:01:18.479024 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:18.478672 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67" Jul 13 03:01:18.481555 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:18.481515 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-njnf7" event={"ID":"40eba173-65f6-4b4a-a198-d6781b5e12f6","Type":"ContainerStarted","Data":"6732302eab91932ee5ed8c970e51a7b1fd0fb05d10f03681b38d59661f7ad227"} Jul 13 03:01:18.484862 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:18.484836 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67" Jul 13 03:01:18.494535 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:18.494481 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-zcm67" podStartSLOduration=1.25052128 podStartE2EDuration="3.494462682s" totalImagesPullingTime="2.243941402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:18.493643275 +0000 UTC m=+259.544450245" watchObservedRunningTime="2026-07-13 03:01:18.494462682 +0000 UTC m=+259.545269633" Jul 13 03:01:18.516293 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:18.516190 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-njnf7" podStartSLOduration=18.095691284 podStartE2EDuration="25.516172177s" totalImagesPullingTime="7.420480893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:00:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:18.515711704 +0000 UTC m=+259.566518658" watchObservedRunningTime="2026-07-13 03:01:18.516172177 +0000 UTC m=+259.566979130" Jul 13 03:01:24.277170 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.277058 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd"] Jul 13 03:01:24.287286 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.287240 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fn64x"] Jul 13 03:01:24.287448 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.287414 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.290361 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.290333 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 13 03:01:24.290552 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.290333 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 13 03:01:24.291114 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.291092 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-zrldr"] Jul 13 03:01:24.291321 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.291254 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.292496 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.292298 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 03:01:24.292625 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.292553 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g2bvn\"" Jul 13 03:01:24.294917 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.294882 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd"] Jul 13 03:01:24.295041 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.295015 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.296680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.296657 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 03:01:24.296850 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.296713 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 03:01:24.297011 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.296993 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9w62j\"" Jul 13 03:01:24.297391 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.297098 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 03:01:24.298196 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.298171 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 13 03:01:24.298305 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.298239 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hdmn7\"" Jul 13 03:01:24.298436 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.298416 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 13 03:01:24.298528 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.298486 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 13 03:01:24.304234 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.304202 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-zrldr"] Jul 13 03:01:24.373818 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.373775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-textfile\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.373984 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.373861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bb6f07-705e-465a-acc6-d895b7861061-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.373984 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.373897 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/759233fd-a5b1-4e6d-b77b-859706b26082-root\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.373984 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.373915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/759233fd-a5b1-4e6d-b77b-859706b26082-metrics-client-ca\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.373984 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.373954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctngl\" (UniqueName: \"kubernetes.io/projected/52bb6f07-705e-465a-acc6-d895b7861061-kube-api-access-ctngl\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.373984 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.373973 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89gnp\" (UniqueName: \"kubernetes.io/projected/961715f0-251e-4dfb-aea4-ef01963c6e7f-kube-api-access-89gnp\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.374193 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.373998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-wtmp\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.374193 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.374036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/759233fd-a5b1-4e6d-b77b-859706b26082-sys\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.374193 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.374069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.374193 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.374091 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/961715f0-251e-4dfb-aea4-ef01963c6e7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.374193 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.374106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/52bb6f07-705e-465a-acc6-d895b7861061-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.374193 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.374123 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52bb6f07-705e-465a-acc6-d895b7861061-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.374193 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.374172 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7wb9\" (UniqueName: \"kubernetes.io/projected/759233fd-a5b1-4e6d-b77b-859706b26082-kube-api-access-d7wb9\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.374397 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.374200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/52bb6f07-705e-465a-acc6-d895b7861061-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.374397 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.374219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52bb6f07-705e-465a-acc6-d895b7861061-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.374397 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.374239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/961715f0-251e-4dfb-aea4-ef01963c6e7f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.374397 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.374278 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/961715f0-251e-4dfb-aea4-ef01963c6e7f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.374397 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.374303 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-tls\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.374397 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.374340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-accelerators-collector-config\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.474770 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.474731 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-tls\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.474931 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.474781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-accelerators-collector-config\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.474931 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.474919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-textfile\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.475059 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.474978 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bb6f07-705e-465a-acc6-d895b7861061-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.475059 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475006 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/759233fd-a5b1-4e6d-b77b-859706b26082-root\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.475059 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475033 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/759233fd-a5b1-4e6d-b77b-859706b26082-metrics-client-ca\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.475205 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctngl\" (UniqueName: \"kubernetes.io/projected/52bb6f07-705e-465a-acc6-d895b7861061-kube-api-access-ctngl\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.475205 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475111 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/759233fd-a5b1-4e6d-b77b-859706b26082-root\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.475205 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475120 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89gnp\" (UniqueName: \"kubernetes.io/projected/961715f0-251e-4dfb-aea4-ef01963c6e7f-kube-api-access-89gnp\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.475205 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-wtmp\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.475404 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475225 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/759233fd-a5b1-4e6d-b77b-859706b26082-sys\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.475404 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.475404 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475299 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/961715f0-251e-4dfb-aea4-ef01963c6e7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.475404 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475324 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/52bb6f07-705e-465a-acc6-d895b7861061-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.475404 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475350 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52bb6f07-705e-465a-acc6-d895b7861061-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.475404 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475376 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7wb9\" (UniqueName: \"kubernetes.io/projected/759233fd-a5b1-4e6d-b77b-859706b26082-kube-api-access-d7wb9\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.475714 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/52bb6f07-705e-465a-acc6-d895b7861061-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.475714 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475427 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-wtmp\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.475714 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52bb6f07-705e-465a-acc6-d895b7861061-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.475714 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:01:24.475163 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 13 03:01:24.475714 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/961715f0-251e-4dfb-aea4-ef01963c6e7f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.475714 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475512 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-accelerators-collector-config\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.475714 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:01:24.475519 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bb6f07-705e-465a-acc6-d895b7861061-kube-state-metrics-tls podName:52bb6f07-705e-465a-acc6-d895b7861061 nodeName:}" failed. No retries permitted until 2026-07-13 03:01:24.97549931 +0000 UTC m=+266.026306245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/52bb6f07-705e-465a-acc6-d895b7861061-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-zrldr" (UID: "52bb6f07-705e-465a-acc6-d895b7861061") : secret "kube-state-metrics-tls" not found Jul 13 03:01:24.475714 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475562 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/961715f0-251e-4dfb-aea4-ef01963c6e7f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.475714 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475537 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-textfile\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.476163 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475744 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/759233fd-a5b1-4e6d-b77b-859706b26082-metrics-client-ca\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.476163 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475823 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/759233fd-a5b1-4e6d-b77b-859706b26082-sys\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.476163 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.475931 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/52bb6f07-705e-465a-acc6-d895b7861061-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.476163 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:01:24.476023 2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 13 03:01:24.476163 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:01:24.476079 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/961715f0-251e-4dfb-aea4-ef01963c6e7f-openshift-state-metrics-tls podName:961715f0-251e-4dfb-aea4-ef01963c6e7f nodeName:}" failed. No retries permitted until 2026-07-13 03:01:24.976063025 +0000 UTC m=+266.026869965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/961715f0-251e-4dfb-aea4-ef01963c6e7f-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-5vkgd" (UID: "961715f0-251e-4dfb-aea4-ef01963c6e7f") : secret "openshift-state-metrics-tls" not found Jul 13 03:01:24.476509 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.476477 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/961715f0-251e-4dfb-aea4-ef01963c6e7f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.476905 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.476829 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/52bb6f07-705e-465a-acc6-d895b7861061-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.477616 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.477591 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52bb6f07-705e-465a-acc6-d895b7861061-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.478500 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.478470 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-tls\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.478890 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.478867 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52bb6f07-705e-465a-acc6-d895b7861061-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.478983 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.478961 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/759233fd-a5b1-4e6d-b77b-859706b26082-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.479073 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.479057 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/961715f0-251e-4dfb-aea4-ef01963c6e7f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.484305 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.484281 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89gnp\" (UniqueName: \"kubernetes.io/projected/961715f0-251e-4dfb-aea4-ef01963c6e7f-kube-api-access-89gnp\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.484534 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.484505 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7wb9\" (UniqueName: \"kubernetes.io/projected/759233fd-a5b1-4e6d-b77b-859706b26082-kube-api-access-d7wb9\") pod \"node-exporter-fn64x\" (UID: \"759233fd-a5b1-4e6d-b77b-859706b26082\") " pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.484667 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.484644 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctngl\" (UniqueName: \"kubernetes.io/projected/52bb6f07-705e-465a-acc6-d895b7861061-kube-api-access-ctngl\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.612075 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.611985 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fn64x" Jul 13 03:01:24.626561 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:01:24.626525 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759233fd_a5b1_4e6d_b77b_859706b26082.slice/crio-ae7f18cd5c4e629c428adfef7d8331a32bc620c925df667a8a83aa0f97d8a51b WatchSource:0}: Error finding container ae7f18cd5c4e629c428adfef7d8331a32bc620c925df667a8a83aa0f97d8a51b: Status 404 returned error can't find the container with id ae7f18cd5c4e629c428adfef7d8331a32bc620c925df667a8a83aa0f97d8a51b Jul 13 03:01:24.980388 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.980347 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bb6f07-705e-465a-acc6-d895b7861061-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:24.980584 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.980432 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/961715f0-251e-4dfb-aea4-ef01963c6e7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.983770 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.983735 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/961715f0-251e-4dfb-aea4-ef01963c6e7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-5vkgd\" (UID: \"961715f0-251e-4dfb-aea4-ef01963c6e7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:24.984039 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:24.984010 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/52bb6f07-705e-465a-acc6-d895b7861061-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-zrldr\" (UID: \"52bb6f07-705e-465a-acc6-d895b7861061\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:25.203266 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:25.203209 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" Jul 13 03:01:25.219123 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:25.219088 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" Jul 13 03:01:25.393687 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:25.393582 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd"] Jul 13 03:01:25.400432 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:01:25.400391 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961715f0_251e_4dfb_aea4_ef01963c6e7f.slice/crio-07068820733e566bf769e64869a1b2a9f084f1c7fa5c912cf31284316c37dc65 WatchSource:0}: Error finding container 07068820733e566bf769e64869a1b2a9f084f1c7fa5c912cf31284316c37dc65: Status 404 returned error can't find the container with id 07068820733e566bf769e64869a1b2a9f084f1c7fa5c912cf31284316c37dc65 Jul 13 03:01:25.416791 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:25.416767 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-zrldr"] Jul 13 03:01:25.420222 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:01:25.420181 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52bb6f07_705e_465a_acc6_d895b7861061.slice/crio-cecfc4f8315a51e7b21237d033f8179f44df32fad7720463bfea00ab0cb4e684 WatchSource:0}: Error finding container cecfc4f8315a51e7b21237d033f8179f44df32fad7720463bfea00ab0cb4e684: Status 404 returned error can't find the container with id cecfc4f8315a51e7b21237d033f8179f44df32fad7720463bfea00ab0cb4e684 Jul 13 03:01:25.515417 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:25.515377 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" event={"ID":"961715f0-251e-4dfb-aea4-ef01963c6e7f","Type":"ContainerStarted","Data":"07068820733e566bf769e64869a1b2a9f084f1c7fa5c912cf31284316c37dc65"} Jul 13 03:01:25.516760 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:25.516728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fn64x" event={"ID":"759233fd-a5b1-4e6d-b77b-859706b26082","Type":"ContainerStarted","Data":"ae7f18cd5c4e629c428adfef7d8331a32bc620c925df667a8a83aa0f97d8a51b"} Jul 13 03:01:25.518072 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:25.518044 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" event={"ID":"52bb6f07-705e-465a-acc6-d895b7861061","Type":"ContainerStarted","Data":"cecfc4f8315a51e7b21237d033f8179f44df32fad7720463bfea00ab0cb4e684"} Jul 13 03:01:26.527085 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:26.526935 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" event={"ID":"961715f0-251e-4dfb-aea4-ef01963c6e7f","Type":"ContainerStarted","Data":"7e64282644b7142b4c5288053966ef9ec887b13eed5bb6a4467394c3a01baf8e"} Jul 13 03:01:26.527085 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:26.527058 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" event={"ID":"961715f0-251e-4dfb-aea4-ef01963c6e7f","Type":"ContainerStarted","Data":"8ea2fbb3ce8ddb6f0fe8543e57473e464601dd67a70f834eba8400a5338f6484"} Jul 13 03:01:26.529223 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:26.529188 2563 generic.go:356] "Generic (PLEG): container finished" podID="759233fd-a5b1-4e6d-b77b-859706b26082" containerID="bd1370ea98d82923f5852fb809267d0d60e688dcb501728fccc9794b1c590494" exitCode=0 Jul 13 03:01:26.529384 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:26.529262 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fn64x" event={"ID":"759233fd-a5b1-4e6d-b77b-859706b26082","Type":"ContainerDied","Data":"bd1370ea98d82923f5852fb809267d0d60e688dcb501728fccc9794b1c590494"} Jul 13 03:01:27.537905 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:27.537870 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fn64x" event={"ID":"759233fd-a5b1-4e6d-b77b-859706b26082","Type":"ContainerStarted","Data":"fc189c562e294fca5bbefefacd277eea4bd830c2081df20761adda00bf308ec0"} Jul 13 03:01:27.538410 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:27.537930 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fn64x" event={"ID":"759233fd-a5b1-4e6d-b77b-859706b26082","Type":"ContainerStarted","Data":"9c8435089472fd41c159167d9f9b0ca603d10e99e6211e4687b8ab1ed9258033"} Jul 13 03:01:27.559777 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:27.559709 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fn64x" podStartSLOduration=1.8510911719999998 podStartE2EDuration="3.559678811s" totalImagesPullingTime="1.579551706s" totalInitContainerRuntime="129.035933ms" isStatefulPod=true podCreationTimestamp="2026-07-13 03:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:27.557323398 +0000 UTC m=+268.608130361" watchObservedRunningTime="2026-07-13 03:01:27.559678811 +0000 UTC m=+268.610485767" Jul 13 03:01:28.670621 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.670580 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc"] Jul 13 03:01:28.673506 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.673478 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.677628 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.677347 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5fjuniuj975kp\"" Jul 13 03:01:28.677628 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.677371 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 13 03:01:28.677628 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.677406 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kj7jg\"" Jul 13 03:01:28.677628 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.677347 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 13 03:01:28.677628 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.677515 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 13 03:01:28.677628 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.677562 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 13 03:01:28.684365 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.684339 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc"] Jul 13 03:01:28.721672 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.721634 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/53b28800-64f1-4dbc-be29-e17dd977486c-metrics-server-audit-profiles\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.721876 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.721726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/53b28800-64f1-4dbc-be29-e17dd977486c-secret-metrics-server-client-certs\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.721876 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.721791 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z82lz\" (UniqueName: \"kubernetes.io/projected/53b28800-64f1-4dbc-be29-e17dd977486c-kube-api-access-z82lz\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.721876 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.721857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53b28800-64f1-4dbc-be29-e17dd977486c-client-ca-bundle\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.722039 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.721919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/53b28800-64f1-4dbc-be29-e17dd977486c-secret-metrics-server-tls\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.722039 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.721948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/53b28800-64f1-4dbc-be29-e17dd977486c-audit-log\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.722039 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.721977 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b28800-64f1-4dbc-be29-e17dd977486c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.823422 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.823375 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z82lz\" (UniqueName: \"kubernetes.io/projected/53b28800-64f1-4dbc-be29-e17dd977486c-kube-api-access-z82lz\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.823639 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.823448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53b28800-64f1-4dbc-be29-e17dd977486c-client-ca-bundle\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.823639 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.823482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/53b28800-64f1-4dbc-be29-e17dd977486c-secret-metrics-server-tls\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.823639 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.823499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/53b28800-64f1-4dbc-be29-e17dd977486c-audit-log\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.823639 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.823521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b28800-64f1-4dbc-be29-e17dd977486c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.823639 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.823557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/53b28800-64f1-4dbc-be29-e17dd977486c-metrics-server-audit-profiles\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.823639 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.823619 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/53b28800-64f1-4dbc-be29-e17dd977486c-secret-metrics-server-client-certs\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.824487 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.824416 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/53b28800-64f1-4dbc-be29-e17dd977486c-audit-log\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.824850 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.824700 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b28800-64f1-4dbc-be29-e17dd977486c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.824998 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.824968 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/53b28800-64f1-4dbc-be29-e17dd977486c-metrics-server-audit-profiles\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.826928 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.826867 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/53b28800-64f1-4dbc-be29-e17dd977486c-secret-metrics-server-tls\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.826928 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.826896 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/53b28800-64f1-4dbc-be29-e17dd977486c-secret-metrics-server-client-certs\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.827100 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.827002 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/53b28800-64f1-4dbc-be29-e17dd977486c-client-ca-bundle\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.832402 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.832376 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z82lz\" (UniqueName: \"kubernetes.io/projected/53b28800-64f1-4dbc-be29-e17dd977486c-kube-api-access-z82lz\") pod \"metrics-server-5d4fc5ddcd-zdxcc\" (UID: \"53b28800-64f1-4dbc-be29-e17dd977486c\") " pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:28.986002 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:28.985963 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:29.043925 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:29.043887 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn"] Jul 13 03:01:29.046357 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:29.046333 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" Jul 13 03:01:29.049007 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:29.048802 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 13 03:01:29.049007 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:29.048909 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dszxn\"" Jul 13 03:01:29.058456 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:29.058412 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn"] Jul 13 03:01:29.126547 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:29.126506 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b45801aa-64bb-4ec6-874f-581074d11270-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jz7fn\" (UID: \"b45801aa-64bb-4ec6-874f-581074d11270\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" Jul 13 03:01:29.126731 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:29.126558 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t4dx\" (UniqueName: \"kubernetes.io/projected/b45801aa-64bb-4ec6-874f-581074d11270-kube-api-access-9t4dx\") pod \"monitoring-plugin-5f68df7f58-jz7fn\" (UID: \"b45801aa-64bb-4ec6-874f-581074d11270\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" Jul 13 03:01:29.227202 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:29.227129 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b45801aa-64bb-4ec6-874f-581074d11270-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jz7fn\" (UID: \"b45801aa-64bb-4ec6-874f-581074d11270\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" Jul 13 03:01:29.227397 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:29.227224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t4dx\" (UniqueName: \"kubernetes.io/projected/b45801aa-64bb-4ec6-874f-581074d11270-kube-api-access-9t4dx\") pod \"monitoring-plugin-5f68df7f58-jz7fn\" (UID: \"b45801aa-64bb-4ec6-874f-581074d11270\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" Jul 13 03:01:29.230160 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:29.230120 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b45801aa-64bb-4ec6-874f-581074d11270-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jz7fn\" (UID: \"b45801aa-64bb-4ec6-874f-581074d11270\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" Jul 13 03:01:29.235906 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:29.235876 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t4dx\" (UniqueName: \"kubernetes.io/projected/b45801aa-64bb-4ec6-874f-581074d11270-kube-api-access-9t4dx\") pod \"monitoring-plugin-5f68df7f58-jz7fn\" (UID: \"b45801aa-64bb-4ec6-874f-581074d11270\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" Jul 13 03:01:29.358066 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:29.357976 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" Jul 13 03:01:30.605534 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.605501 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 03:01:30.608687 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.608656 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.612128 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.612101 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 13 03:01:30.612292 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.612166 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 13 03:01:30.612545 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.612521 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 13 03:01:30.614248 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.614220 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 13 03:01:30.614484 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.614467 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 13 03:01:30.614547 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.614488 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-evecagkirq5pi\"" Jul 13 03:01:30.614600 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.614555 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 13 03:01:30.614973 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.614813 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 13 03:01:30.615893 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.615873 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 13 03:01:30.615981 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.615873 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 13 03:01:30.619186 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.618945 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 13 03:01:30.619472 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.619442 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 13 03:01:30.619580 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.619532 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 13 03:01:30.619715 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.619696 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 13 03:01:30.620893 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.620851 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dvf9r\"" Jul 13 03:01:30.633171 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.633097 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 13 03:01:30.634515 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.634486 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 03:01:30.741340 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741518 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741518 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741518 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741426 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0335cd35-ecb0-4f86-958b-9288b11e4371-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741591 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-config\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741627 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh7wx\" (UniqueName: \"kubernetes.io/projected/0335cd35-ecb0-4f86-958b-9288b11e4371-kube-api-access-vh7wx\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741854 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741722 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741854 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741748 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741854 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741778 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-web-config\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741979 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741979 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741979 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741914 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741979 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741937 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.741979 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.741962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.742270 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.742008 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.742270 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.742075 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.742270 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.742099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0335cd35-ecb0-4f86-958b-9288b11e4371-config-out\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.742270 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.742122 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.842892 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.842843 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.842892 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.842901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.843185 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.842932 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0335cd35-ecb0-4f86-958b-9288b11e4371-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.843185 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.842966 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.843292 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.843191 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-config\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.843292 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.843245 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.843292 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.843281 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh7wx\" (UniqueName: \"kubernetes.io/projected/0335cd35-ecb0-4f86-958b-9288b11e4371-kube-api-access-vh7wx\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.843444 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.843337 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.843444 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.843365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.843444 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.843396 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-web-config\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.843583 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.843447 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.844785 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.844631 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.845525 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.845492 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.846260 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.846323 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.846372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.846399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.846427 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.846457 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.846489 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.846517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0335cd35-ecb0-4f86-958b-9288b11e4371-config-out\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.846543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.846579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.846594 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.846729 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0335cd35-ecb0-4f86-958b-9288b11e4371-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.847235 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.847274 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.847318 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.847455 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.847346 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.848336 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.847486 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.848336 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.847742 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.848336 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.848024 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.848336 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.848081 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.848708 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.848515 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-config\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.849114 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.849092 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-web-config\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.850353 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.850329 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0335cd35-ecb0-4f86-958b-9288b11e4371-config-out\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.850472 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.850393 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.850472 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.850400 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.851332 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.851311 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.859879 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.859722 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh7wx\" (UniqueName: \"kubernetes.io/projected/0335cd35-ecb0-4f86-958b-9288b11e4371-kube-api-access-vh7wx\") pod \"prometheus-k8s-0\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:30.922629 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:30.922589 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:34.900697 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:34.895195 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn"] Jul 13 03:01:35.129068 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.128863 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc"] Jul 13 03:01:35.131966 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:01:35.131929 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b28800_64f1_4dbc_be29_e17dd977486c.slice/crio-2ae232187b9322c7695d8386d6cb6cc394a0221bb5af0b41a8036b77d52b5496 WatchSource:0}: Error finding container 2ae232187b9322c7695d8386d6cb6cc394a0221bb5af0b41a8036b77d52b5496: Status 404 returned error can't find the container with id 2ae232187b9322c7695d8386d6cb6cc394a0221bb5af0b41a8036b77d52b5496 Jul 13 03:01:35.148051 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.148016 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 03:01:35.154483 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:01:35.154438 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0335cd35_ecb0_4f86_958b_9288b11e4371.slice/crio-2f5d484809a8d698edc6e776c409ba3059d125a03b9a59341ffff1c7065e5256 WatchSource:0}: Error finding container 2f5d484809a8d698edc6e776c409ba3059d125a03b9a59341ffff1c7065e5256: Status 404 returned error can't find the container with id 2f5d484809a8d698edc6e776c409ba3059d125a03b9a59341ffff1c7065e5256 Jul 13 03:01:35.575203 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.575129 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" event={"ID":"b45801aa-64bb-4ec6-874f-581074d11270","Type":"ContainerStarted","Data":"bd5b1100b4de9d6c233aac3c0bb100bfb01c40894afb2f931f044234fffa86d6"} Jul 13 03:01:35.577667 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.577596 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-2w2qq" event={"ID":"c6907df4-7a1d-4a0b-8d71-df1fa6b70e91","Type":"ContainerStarted","Data":"977c0834e9b2d4fd905dba9a859ec336007504a5be891aa13e5617ba2c618d13"} Jul 13 03:01:35.578700 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.578671 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-2w2qq" Jul 13 03:01:35.581053 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.581009 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" event={"ID":"53b28800-64f1-4dbc-be29-e17dd977486c","Type":"ContainerStarted","Data":"2ae232187b9322c7695d8386d6cb6cc394a0221bb5af0b41a8036b77d52b5496"} Jul 13 03:01:35.582676 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.582599 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerStarted","Data":"2f5d484809a8d698edc6e776c409ba3059d125a03b9a59341ffff1c7065e5256"} Jul 13 03:01:35.585831 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.585801 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" event={"ID":"961715f0-251e-4dfb-aea4-ef01963c6e7f","Type":"ContainerStarted","Data":"064394f09d721a2b55be232b126639d5944fd1ad3e80035d06c2a4f71e46f390"} Jul 13 03:01:35.588993 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.588897 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" event={"ID":"52bb6f07-705e-465a-acc6-d895b7861061","Type":"ContainerStarted","Data":"f2673847eb6448c74d3f4d5655de8386268d7e2859fa46d9d9b3f35e16fa0b02"} Jul 13 03:01:35.589443 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.589353 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" event={"ID":"52bb6f07-705e-465a-acc6-d895b7861061","Type":"ContainerStarted","Data":"61900a5a05a9a71926bf4374bed5ef0d6562c0f8f96cf7cc838323b0404ec639"} Jul 13 03:01:35.589443 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.589403 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" event={"ID":"52bb6f07-705e-465a-acc6-d895b7861061","Type":"ContainerStarted","Data":"e753b187629eb102e533683c6f951c23f7d41c48e14e994a37f67d364c6214c2"} Jul 13 03:01:35.595363 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.595324 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-2w2qq" Jul 13 03:01:35.596343 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.596292 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-2w2qq" podStartSLOduration=1.902568983 podStartE2EDuration="20.596279028s" totalImagesPullingTime="18.693710045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:35.595291127 +0000 UTC m=+276.646098084" watchObservedRunningTime="2026-07-13 03:01:35.596279028 +0000 UTC m=+276.647085985" Jul 13 03:01:35.642892 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.642823 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-zrldr" podStartSLOduration=2.3810174 podStartE2EDuration="11.642799567s" totalImagesPullingTime="9.261782167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:35.641207332 +0000 UTC m=+276.692014290" watchObservedRunningTime="2026-07-13 03:01:35.642799567 +0000 UTC m=+276.693606525" Jul 13 03:01:35.668320 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:35.668242 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-5vkgd" podStartSLOduration=2.941752765 podStartE2EDuration="11.668219369s" totalImagesPullingTime="8.726466604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:35.667391929 +0000 UTC m=+276.718198889" watchObservedRunningTime="2026-07-13 03:01:35.668219369 +0000 UTC m=+276.719026325" Jul 13 03:01:37.478739 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:37.478645 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-859795f5db-lrfbd" Jul 13 03:01:39.616999 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:39.616948 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" event={"ID":"b45801aa-64bb-4ec6-874f-581074d11270","Type":"ContainerStarted","Data":"45348b1cae600f04932ede1d6860d1a779bff139ddd6ce3909e1ca9456c93730"} Jul 13 03:01:39.617496 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:39.617249 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" Jul 13 03:01:39.620317 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:39.620276 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" event={"ID":"53b28800-64f1-4dbc-be29-e17dd977486c","Type":"ContainerStarted","Data":"4f8cb3600c823dc2e207f843c24ee50a99946b5f551191539b02444220aae88a"} Jul 13 03:01:39.623119 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:39.623080 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" Jul 13 03:01:39.623911 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:39.623879 2563 generic.go:356] "Generic (PLEG): container finished" podID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerID="512f586f26e95708989e26ba15c7756f423b2be4221b6229256402718966f305" exitCode=0 Jul 13 03:01:39.624074 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:39.624047 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerDied","Data":"512f586f26e95708989e26ba15c7756f423b2be4221b6229256402718966f305"} Jul 13 03:01:39.635119 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:39.635068 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jz7fn" podStartSLOduration=7.052285979 podStartE2EDuration="10.635047667s" totalImagesPullingTime="3.582761688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:39.634177269 +0000 UTC m=+280.684984238" watchObservedRunningTime="2026-07-13 03:01:39.635047667 +0000 UTC m=+280.685854604" Jul 13 03:01:39.656474 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:39.656413 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" podStartSLOduration=8.293731004 podStartE2EDuration="11.656389451s" totalImagesPullingTime="3.362658447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:39.656327027 +0000 UTC m=+280.707133987" watchObservedRunningTime="2026-07-13 03:01:39.656389451 +0000 UTC m=+280.707196408" Jul 13 03:01:41.160694 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:01:41.160618 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fshqz" podUID="b30fb41b-3f0b-4428-a776-d07b8c2d071f" Jul 13 03:01:41.635952 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:41.635911 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fshqz" Jul 13 03:01:44.655346 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:44.655304 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerStarted","Data":"e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51"} Jul 13 03:01:44.655783 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:44.655394 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerStarted","Data":"d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1"} Jul 13 03:01:44.801247 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:44.801202 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 03:01:44.805425 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:44.805352 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b30fb41b-3f0b-4428-a776-d07b8c2d071f-metrics-tls\") pod \"dns-default-fshqz\" (UID: \"b30fb41b-3f0b-4428-a776-d07b8c2d071f\") " pod="openshift-dns/dns-default-fshqz" Jul 13 03:01:44.939619 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:44.939585 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vw8zn\"" Jul 13 03:01:44.947149 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:44.947112 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fshqz" Jul 13 03:01:45.133322 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:45.133283 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fshqz"] Jul 13 03:01:45.136915 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:01:45.136880 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30fb41b_3f0b_4428_a776_d07b8c2d071f.slice/crio-1b157795fdc9f8fac2334ac965de367237ec0b8897bee146c1bec08bfc46863a WatchSource:0}: Error finding container 1b157795fdc9f8fac2334ac965de367237ec0b8897bee146c1bec08bfc46863a: Status 404 returned error can't find the container with id 1b157795fdc9f8fac2334ac965de367237ec0b8897bee146c1bec08bfc46863a Jul 13 03:01:45.661751 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:45.661712 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fshqz" event={"ID":"b30fb41b-3f0b-4428-a776-d07b8c2d071f","Type":"ContainerStarted","Data":"1b157795fdc9f8fac2334ac965de367237ec0b8897bee146c1bec08bfc46863a"} Jul 13 03:01:46.672902 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:46.671884 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerStarted","Data":"49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9"} Jul 13 03:01:47.680206 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:47.680166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerStarted","Data":"7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59"} Jul 13 03:01:47.680611 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:47.680236 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerStarted","Data":"7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc"} Jul 13 03:01:47.680611 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:47.680262 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerStarted","Data":"e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e"} Jul 13 03:01:47.713001 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:47.712920 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.82699782 podStartE2EDuration="17.7128949s" totalImagesPullingTime="9.860569987s" totalInitContainerRuntime="25.327093ms" isStatefulPod=false podCreationTimestamp="2026-07-13 03:01:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:47.711069126 +0000 UTC m=+288.761876112" watchObservedRunningTime="2026-07-13 03:01:47.7128949 +0000 UTC m=+288.763701861" Jul 13 03:01:48.685728 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:48.685636 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fshqz" event={"ID":"b30fb41b-3f0b-4428-a776-d07b8c2d071f","Type":"ContainerStarted","Data":"57d9c7ca757ff52c1f08d27daa91327657eec7eac5f301ea36d8d0bdfede2b7c"} Jul 13 03:01:48.685728 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:48.685693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fshqz" event={"ID":"b30fb41b-3f0b-4428-a776-d07b8c2d071f","Type":"ContainerStarted","Data":"76ba4f484e5ff4ae7189a70fb91cab5f09c480852397128eebda548f61c6c73a"} Jul 13 03:01:48.686360 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:48.685737 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fshqz" Jul 13 03:01:48.706487 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:48.706435 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fshqz" podStartSLOduration=251.889936786 podStartE2EDuration="4m14.706416341s" totalImagesPullingTime="2.816479555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 02:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:01:48.70451968 +0000 UTC m=+289.755326638" watchObservedRunningTime="2026-07-13 03:01:48.706416341 +0000 UTC m=+289.757223297" Jul 13 03:01:48.986477 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:48.986432 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:48.986742 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:48.986511 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:01:50.922940 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:50.922894 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:01:58.693728 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:58.693695 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fshqz" Jul 13 03:01:59.324896 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:59.324864 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:01:59.324896 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:59.324893 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:01:59.336435 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:01:59.336410 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 03:02:08.992089 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:08.992058 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:02:08.996011 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:08.995990 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5d4fc5ddcd-zdxcc" Jul 13 03:02:12.786974 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:12.786933 2563 generic.go:356] "Generic (PLEG): container finished" podID="3cc96dbc-0428-466b-abf1-b79890000d7b" containerID="77eb32442aaa8d2a5cb2103d783368f7f8a534e5e2283dc7ecb9b6c3b0537da6" exitCode=0 Jul 13 03:02:12.787417 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:12.787007 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" event={"ID":"3cc96dbc-0428-466b-abf1-b79890000d7b","Type":"ContainerDied","Data":"77eb32442aaa8d2a5cb2103d783368f7f8a534e5e2283dc7ecb9b6c3b0537da6"} Jul 13 03:02:12.787417 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:12.787346 2563 scope.go:117] "RemoveContainer" containerID="77eb32442aaa8d2a5cb2103d783368f7f8a534e5e2283dc7ecb9b6c3b0537da6" Jul 13 03:02:13.792421 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:13.792387 2563 generic.go:356] "Generic (PLEG): container finished" podID="4a176d83-a5e9-45cf-b5f5-f64d25f4e878" containerID="f2bfa9777e83539e7b4c60a4f416bd8ff5f575e869006f87e4e8de9971a922a1" exitCode=0 Jul 13 03:02:13.792881 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:13.792460 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" event={"ID":"4a176d83-a5e9-45cf-b5f5-f64d25f4e878","Type":"ContainerDied","Data":"f2bfa9777e83539e7b4c60a4f416bd8ff5f575e869006f87e4e8de9971a922a1"} Jul 13 03:02:13.792881 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:13.792856 2563 scope.go:117] "RemoveContainer" containerID="f2bfa9777e83539e7b4c60a4f416bd8ff5f575e869006f87e4e8de9971a922a1" Jul 13 03:02:13.794662 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:13.794633 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-4b9bp" event={"ID":"3cc96dbc-0428-466b-abf1-b79890000d7b","Type":"ContainerStarted","Data":"8f565e6b73123ddb16b38223419e910c0057753011336c744d99a51512c51002"} Jul 13 03:02:14.800203 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:14.800165 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-ggnr5" event={"ID":"4a176d83-a5e9-45cf-b5f5-f64d25f4e878","Type":"ContainerStarted","Data":"4ce781b2f9154dce021156dcf3a6b665bd26ee89b0f2471dd4b17f493583e89f"} Jul 13 03:02:30.923035 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:30.922969 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:30.943584 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:30.943552 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:31.895658 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:31.895632 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:48.863241 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:48.863207 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 03:02:48.863645 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:48.863536 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="prometheus" containerID="cri-o://d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1" gracePeriod=600 Jul 13 03:02:48.863645 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:48.863592 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59" gracePeriod=600 Jul 13 03:02:48.863645 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:48.863615 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="config-reloader" containerID="cri-o://e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51" gracePeriod=600 Jul 13 03:02:48.863820 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:48.863570 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="kube-rbac-proxy" containerID="cri-o://7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc" gracePeriod=600 Jul 13 03:02:48.863820 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:48.863555 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="thanos-sidecar" containerID="cri-o://49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9" gracePeriod=600 Jul 13 03:02:48.863820 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:48.863577 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="kube-rbac-proxy-web" containerID="cri-o://e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e" gracePeriod=600 Jul 13 03:02:49.971914 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:49.971881 2563 generic.go:356] "Generic (PLEG): container finished" podID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerID="7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59" exitCode=0 Jul 13 03:02:49.971914 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:49.971907 2563 generic.go:356] "Generic (PLEG): container finished" podID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerID="7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc" exitCode=0 Jul 13 03:02:49.971914 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:49.971913 2563 generic.go:356] "Generic (PLEG): container finished" podID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerID="49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9" exitCode=0 Jul 13 03:02:49.971914 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:49.971919 2563 generic.go:356] "Generic (PLEG): container finished" podID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerID="e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51" exitCode=0 Jul 13 03:02:49.971914 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:49.971924 2563 generic.go:356] "Generic (PLEG): container finished" podID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerID="d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1" exitCode=0 Jul 13 03:02:49.972393 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:49.971965 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerDied","Data":"7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59"} Jul 13 03:02:49.972393 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:49.972059 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerDied","Data":"7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc"} Jul 13 03:02:49.972393 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:49.972106 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerDied","Data":"49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9"} Jul 13 03:02:49.972393 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:49.972171 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerDied","Data":"e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51"} Jul 13 03:02:49.972393 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:49.972213 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerDied","Data":"d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1"} Jul 13 03:02:50.116092 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.116062 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:50.188249 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188224 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-kubelet-serving-ca-bundle\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188427 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188263 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-trusted-ca-bundle\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188427 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188281 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-1\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188427 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188307 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-grpc-tls\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188427 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188329 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-metrics-client-certs\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188427 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188372 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0335cd35-ecb0-4f86-958b-9288b11e4371-tls-assets\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188427 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188392 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-web-config\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188427 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188419 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh7wx\" (UniqueName: \"kubernetes.io/projected/0335cd35-ecb0-4f86-958b-9288b11e4371-kube-api-access-vh7wx\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188460 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188491 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-2\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188517 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-config\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188541 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188566 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0335cd35-ecb0-4f86-958b-9288b11e4371-config-out\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188596 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-0\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188622 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-db\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188617 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188656 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-thanos-prometheus-http-client-file\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188705 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-metrics-client-ca\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188717 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188723 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:50.188778 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188739 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-tls\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.189445 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.188901 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:50.189445 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.189093 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-kube-rbac-proxy\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.189445 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.189128 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-serving-certs-ca-bundle\") pod \"0335cd35-ecb0-4f86-958b-9288b11e4371\" (UID: \"0335cd35-ecb0-4f86-958b-9288b11e4371\") " Jul 13 03:02:50.189658 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.189636 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.189716 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.189663 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.189716 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.189678 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.189716 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.189695 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.191077 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.189959 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:50.191077 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.190011 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:50.191465 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.191231 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:02:50.192306 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.191961 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0335cd35-ecb0-4f86-958b-9288b11e4371-kube-api-access-vh7wx" (OuterVolumeSpecName: "kube-api-access-vh7wx") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "kube-api-access-vh7wx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:02:50.192705 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.192672 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:50.192919 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.192897 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0335cd35-ecb0-4f86-958b-9288b11e4371-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:02:50.193757 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.193402 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:50.193757 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.193570 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-config" (OuterVolumeSpecName: "config") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:50.193757 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.193711 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 03:02:50.193757 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.193711 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:50.194468 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.194443 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:50.194793 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.194766 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:50.195307 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.195279 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:50.196083 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.196057 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0335cd35-ecb0-4f86-958b-9288b11e4371-config-out" (OuterVolumeSpecName: "config-out") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:02:50.196504 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.196482 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:50.206653 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.206613 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-web-config" (OuterVolumeSpecName: "web-config") pod "0335cd35-ecb0-4f86-958b-9288b11e4371" (UID: "0335cd35-ecb0-4f86-958b-9288b11e4371"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:02:50.290521 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290481 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-grpc-tls\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290521 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290513 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-metrics-client-certs\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290521 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290526 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0335cd35-ecb0-4f86-958b-9288b11e4371-tls-assets\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290535 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-web-config\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290543 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh7wx\" (UniqueName: \"kubernetes.io/projected/0335cd35-ecb0-4f86-958b-9288b11e4371-kube-api-access-vh7wx\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290554 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290563 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-config\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290571 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290579 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0335cd35-ecb0-4f86-958b-9288b11e4371-config-out\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290587 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290595 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0335cd35-ecb0-4f86-958b-9288b11e4371-prometheus-k8s-db\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290603 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290613 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-metrics-client-ca\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290621 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290629 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0335cd35-ecb0-4f86-958b-9288b11e4371-secret-kube-rbac-proxy\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.290748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.290637 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0335cd35-ecb0-4f86-958b-9288b11e4371-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:02:50.978977 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.978939 2563 generic.go:356] "Generic (PLEG): container finished" podID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerID="e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e" exitCode=0 Jul 13 03:02:50.979372 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.979016 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerDied","Data":"e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e"} Jul 13 03:02:50.979372 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.979034 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:50.979372 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.979091 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0335cd35-ecb0-4f86-958b-9288b11e4371","Type":"ContainerDied","Data":"2f5d484809a8d698edc6e776c409ba3059d125a03b9a59341ffff1c7065e5256"} Jul 13 03:02:50.979372 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.979124 2563 scope.go:117] "RemoveContainer" containerID="7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59" Jul 13 03:02:50.988661 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.988642 2563 scope.go:117] "RemoveContainer" containerID="7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc" Jul 13 03:02:50.996566 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:50.996545 2563 scope.go:117] "RemoveContainer" containerID="e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e" Jul 13 03:02:51.003663 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.003633 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 03:02:51.005382 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.005365 2563 scope.go:117] "RemoveContainer" containerID="49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9" Jul 13 03:02:51.013718 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.013695 2563 scope.go:117] "RemoveContainer" containerID="e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51" Jul 13 03:02:51.014085 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.014059 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 03:02:51.021594 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.021569 2563 scope.go:117] "RemoveContainer" containerID="d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1" Jul 13 03:02:51.029962 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.029939 2563 scope.go:117] "RemoveContainer" containerID="512f586f26e95708989e26ba15c7756f423b2be4221b6229256402718966f305" Jul 13 03:02:51.038030 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.038010 2563 scope.go:117] "RemoveContainer" containerID="7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59" Jul 13 03:02:51.038389 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:02:51.038366 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59\": container with ID starting with 7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59 not found: ID does not exist" containerID="7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59" Jul 13 03:02:51.038451 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.038399 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59"} err="failed to get container status \"7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59\": rpc error: code = NotFound desc = could not find container \"7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59\": container with ID starting with 7a3ac3836e6779f6fa5398619637ab06765c034578a7d639550250f3d2b04d59 not found: ID does not exist" Jul 13 03:02:51.038451 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.038436 2563 scope.go:117] "RemoveContainer" containerID="7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc" Jul 13 03:02:51.038687 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:02:51.038672 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc\": container with ID starting with 7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc not found: ID does not exist" containerID="7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc" Jul 13 03:02:51.038742 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.038691 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc"} err="failed to get container status \"7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc\": rpc error: code = NotFound desc = could not find container \"7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc\": container with ID starting with 7717a396ce5f90d7f9e35270d38fe857d055a8b12d09f6c0896f60c0fb2967cc not found: ID does not exist" Jul 13 03:02:51.038742 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.038703 2563 scope.go:117] "RemoveContainer" containerID="e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e" Jul 13 03:02:51.038947 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:02:51.038931 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e\": container with ID starting with e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e not found: ID does not exist" containerID="e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e" Jul 13 03:02:51.038989 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.038951 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e"} err="failed to get container status \"e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e\": rpc error: code = NotFound desc = could not find container \"e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e\": container with ID starting with e9b089bb6f1b21fe3f51106eb2e68a668f889d2861814ff719d8b3f440327e7e not found: ID does not exist" Jul 13 03:02:51.038989 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.038966 2563 scope.go:117] "RemoveContainer" containerID="49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9" Jul 13 03:02:51.039216 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:02:51.039198 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9\": container with ID starting with 49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9 not found: ID does not exist" containerID="49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9" Jul 13 03:02:51.039275 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.039224 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9"} err="failed to get container status \"49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9\": rpc error: code = NotFound desc = could not find container \"49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9\": container with ID starting with 49a205c9d165fa76ed8a8291b69ad2ceb6cb1bcb402e6af2825a3a0648b9dda9 not found: ID does not exist" Jul 13 03:02:51.039275 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.039246 2563 scope.go:117] "RemoveContainer" containerID="e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51" Jul 13 03:02:51.039500 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:02:51.039480 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51\": container with ID starting with e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51 not found: ID does not exist" containerID="e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51" Jul 13 03:02:51.039558 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.039506 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51"} err="failed to get container status \"e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51\": rpc error: code = NotFound desc = could not find container \"e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51\": container with ID starting with e1a5a5efc28f5859c1bf9eb3f53badc21b920ae965fc826eee670417c793cf51 not found: ID does not exist" Jul 13 03:02:51.039558 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.039521 2563 scope.go:117] "RemoveContainer" containerID="d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1" Jul 13 03:02:51.039890 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:02:51.039855 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1\": container with ID starting with d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1 not found: ID does not exist" containerID="d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1" Jul 13 03:02:51.040041 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.039895 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1"} err="failed to get container status \"d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1\": rpc error: code = NotFound desc = could not find container \"d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1\": container with ID starting with d92d73b713ec42adb6f636b4e5354f35814bcce3cf65de3cbad17be3debe88a1 not found: ID does not exist" Jul 13 03:02:51.040041 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.039914 2563 scope.go:117] "RemoveContainer" containerID="512f586f26e95708989e26ba15c7756f423b2be4221b6229256402718966f305" Jul 13 03:02:51.040593 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:02:51.040297 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"512f586f26e95708989e26ba15c7756f423b2be4221b6229256402718966f305\": container with ID starting with 512f586f26e95708989e26ba15c7756f423b2be4221b6229256402718966f305 not found: ID does not exist" containerID="512f586f26e95708989e26ba15c7756f423b2be4221b6229256402718966f305" Jul 13 03:02:51.040593 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.040336 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"512f586f26e95708989e26ba15c7756f423b2be4221b6229256402718966f305"} err="failed to get container status \"512f586f26e95708989e26ba15c7756f423b2be4221b6229256402718966f305\": rpc error: code = NotFound desc = could not find container \"512f586f26e95708989e26ba15c7756f423b2be4221b6229256402718966f305\": container with ID starting with 512f586f26e95708989e26ba15c7756f423b2be4221b6229256402718966f305 not found: ID does not exist" Jul 13 03:02:51.041766 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.041746 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 03:02:51.042055 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042044 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="prometheus" Jul 13 03:02:51.042091 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042058 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="prometheus" Jul 13 03:02:51.042091 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042071 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="init-config-reloader" Jul 13 03:02:51.042091 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042076 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="init-config-reloader" Jul 13 03:02:51.042091 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042083 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="kube-rbac-proxy-web" Jul 13 03:02:51.042091 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042088 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="kube-rbac-proxy-web" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042097 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="kube-rbac-proxy" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042102 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="kube-rbac-proxy" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042109 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="kube-rbac-proxy-thanos" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042114 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="kube-rbac-proxy-thanos" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042123 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="thanos-sidecar" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042129 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="thanos-sidecar" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042154 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="config-reloader" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042160 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="config-reloader" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042215 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="kube-rbac-proxy-thanos" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042222 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="thanos-sidecar" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042227 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="prometheus" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042234 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="config-reloader" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042239 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="kube-rbac-proxy" Jul 13 03:02:51.042257 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.042245 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" containerName="kube-rbac-proxy-web" Jul 13 03:02:51.045333 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.045315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.048316 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.048291 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 13 03:02:51.048462 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.048312 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 13 03:02:51.048462 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.048400 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-evecagkirq5pi\"" Jul 13 03:02:51.048462 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.048400 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 13 03:02:51.048462 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.048452 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 13 03:02:51.048677 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.048618 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 13 03:02:51.048677 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.048659 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dvf9r\"" Jul 13 03:02:51.048811 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.048735 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 13 03:02:51.048811 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.048793 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 13 03:02:51.049375 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.049324 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 13 03:02:51.049375 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.049354 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 13 03:02:51.049375 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.049362 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 13 03:02:51.049705 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.049687 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 13 03:02:51.049764 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.049719 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 13 03:02:51.053561 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.053537 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 13 03:02:51.054578 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.054558 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 13 03:02:51.065737 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.065710 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 03:02:51.095384 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.095384 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.095384 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095405 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-web-config\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.095680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzxc\" (UniqueName: \"kubernetes.io/projected/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-kube-api-access-4gzxc\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.095680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095469 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.095680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-config\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.095680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-config-out\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.095680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.095680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095567 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.095680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095582 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.095680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.095680 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.096012 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.096012 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095725 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.096012 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095742 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.096012 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095800 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.096012 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.096012 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095873 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.096012 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.096012 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.095913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.196754 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.196655 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.196754 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.196696 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.196754 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.196718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197021 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.196836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197021 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.196873 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197021 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.196900 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-web-config\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197021 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.196921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzxc\" (UniqueName: \"kubernetes.io/projected/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-kube-api-access-4gzxc\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197021 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.196960 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197021 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.196997 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-config\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197362 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-config-out\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197362 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197362 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197362 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197362 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197199 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197362 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197362 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197362 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197287 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197362 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197309 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197362 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197353 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197989 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197989 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197602 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.197989 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.197786 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.198203 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.198180 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.200323 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.199181 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.200323 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.199494 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.200323 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.199907 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.200567 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.200510 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.201809 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.201771 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.202115 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.202084 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-config\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.209383 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.202735 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-web-config\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.209383 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.202831 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.209383 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.202840 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-config-out\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.209383 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.202933 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.209383 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.203509 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.209383 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.203597 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.209383 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.203618 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.209383 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.205788 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.209383 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.207177 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.209383 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.207627 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzxc\" (UniqueName: \"kubernetes.io/projected/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-kube-api-access-4gzxc\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.209966 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.209748 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.356103 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.356060 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:02:51.469421 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.469336 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0335cd35-ecb0-4f86-958b-9288b11e4371" path="/var/lib/kubelet/pods/0335cd35-ecb0-4f86-958b-9288b11e4371/volumes" Jul 13 03:02:51.508707 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.508678 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 03:02:51.510639 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:02:51.510609 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb48a7d8f_a4d6_4260_b71f_a337ea1bd1d0.slice/crio-5e60b0e5a7b1ecaccee4d57a6a75874296ec0b7c5c14665527c4539688c1fd97 WatchSource:0}: Error finding container 5e60b0e5a7b1ecaccee4d57a6a75874296ec0b7c5c14665527c4539688c1fd97: Status 404 returned error can't find the container with id 5e60b0e5a7b1ecaccee4d57a6a75874296ec0b7c5c14665527c4539688c1fd97 Jul 13 03:02:51.985099 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.985061 2563 generic.go:356] "Generic (PLEG): container finished" podID="b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0" containerID="e42cfa151120a2892f9f3a7571099866f121f871918fd8e599e8802c5d37a804" exitCode=0 Jul 13 03:02:51.985581 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.985178 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0","Type":"ContainerDied","Data":"e42cfa151120a2892f9f3a7571099866f121f871918fd8e599e8802c5d37a804"} Jul 13 03:02:51.985581 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:51.985279 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0","Type":"ContainerStarted","Data":"5e60b0e5a7b1ecaccee4d57a6a75874296ec0b7c5c14665527c4539688c1fd97"} Jul 13 03:02:52.992838 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:52.992805 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0","Type":"ContainerStarted","Data":"291b7c7a4a6438aee5bbf1a1affff20a55c9c00dfc4698d81667bac9174ae89c"} Jul 13 03:02:52.993214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:52.992870 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0","Type":"ContainerStarted","Data":"c8aedf62c9b6972681e51b5cdf6c9ca3359ae04e7075f7f8cdf8302a934dcb6b"} Jul 13 03:02:52.993214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:52.992895 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0","Type":"ContainerStarted","Data":"8699aac0ef99148ef6e3b3a4956b96c6dcc83b800d97786febc29e16ff2f9bd9"} Jul 13 03:02:52.993214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:52.992918 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0","Type":"ContainerStarted","Data":"465d546a8fefa015ab01c43096ce89c013874f03daa524814a46b1e256d7cc34"} Jul 13 03:02:52.993214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:52.992943 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0","Type":"ContainerStarted","Data":"e1dd8ca167566f0d1c9eb040c363ca63d71cd93f4aaa07ba2db6e1dd9ee8fc5e"} Jul 13 03:02:52.993214 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:52.992972 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0","Type":"ContainerStarted","Data":"76ba043a0b223ed2c464e258f4fc1b4f8d02f3dffb35b6b9bf9eb80953167405"} Jul 13 03:02:53.027275 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:53.027221 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.006688153 podStartE2EDuration="2.027199761s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.511608ms" isStatefulPod=false podCreationTimestamp="2026-07-13 03:02:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:02:53.024488794 +0000 UTC m=+354.075295753" watchObservedRunningTime="2026-07-13 03:02:53.027199761 +0000 UTC m=+354.078006717" Jul 13 03:02:56.356229 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:02:56.356187 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:03:51.357075 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:03:51.357032 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:03:51.373972 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:03:51.373935 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:03:52.253095 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:03:52.253066 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 03:05:01.452358 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.452324 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp"] Jul 13 03:05:01.454741 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.454719 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.458067 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.458041 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 03:05:01.458293 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.458192 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 03:05:01.458293 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.458201 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 03:05:01.458476 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.458339 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4gp7m\"" Jul 13 03:05:01.458529 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.458516 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 03:05:01.470915 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.470871 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp"] Jul 13 03:05:01.530200 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.530127 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7889f8e7-2f27-434a-993a-6fec8c4cbba3-tmp\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.530384 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.530217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7889f8e7-2f27-434a-993a-6fec8c4cbba3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.530384 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.530241 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxtws\" (UniqueName: \"kubernetes.io/projected/7889f8e7-2f27-434a-993a-6fec8c4cbba3-kube-api-access-sxtws\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.530384 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.530314 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7889f8e7-2f27-434a-993a-6fec8c4cbba3-manifests\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.530384 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.530344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7889f8e7-2f27-434a-993a-6fec8c4cbba3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.634184 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.631283 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7889f8e7-2f27-434a-993a-6fec8c4cbba3-tmp\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.634184 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.631367 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7889f8e7-2f27-434a-993a-6fec8c4cbba3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.634184 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.631409 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxtws\" (UniqueName: \"kubernetes.io/projected/7889f8e7-2f27-434a-993a-6fec8c4cbba3-kube-api-access-sxtws\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.634184 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.631504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7889f8e7-2f27-434a-993a-6fec8c4cbba3-manifests\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.634184 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.631548 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7889f8e7-2f27-434a-993a-6fec8c4cbba3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.635245 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.634861 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7889f8e7-2f27-434a-993a-6fec8c4cbba3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.635245 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.635165 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7889f8e7-2f27-434a-993a-6fec8c4cbba3-manifests\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.636881 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.636849 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7889f8e7-2f27-434a-993a-6fec8c4cbba3-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.638744 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.638718 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7889f8e7-2f27-434a-993a-6fec8c4cbba3-tmp\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.647790 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.647750 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxtws\" (UniqueName: \"kubernetes.io/projected/7889f8e7-2f27-434a-993a-6fec8c4cbba3-kube-api-access-sxtws\") pod \"opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp\" (UID: \"7889f8e7-2f27-434a-993a-6fec8c4cbba3\") " pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.765122 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.765024 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:01.923841 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.923798 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp"] Jul 13 03:05:01.928340 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:05:01.928306 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7889f8e7_2f27_434a_993a_6fec8c4cbba3.slice/crio-a3b72951a368853ca50a4969d62b266b5aca7af23fa5cdc4114845a0ee29418e WatchSource:0}: Error finding container a3b72951a368853ca50a4969d62b266b5aca7af23fa5cdc4114845a0ee29418e: Status 404 returned error can't find the container with id a3b72951a368853ca50a4969d62b266b5aca7af23fa5cdc4114845a0ee29418e Jul 13 03:05:01.930434 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:01.930413 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 03:05:02.528874 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:02.528836 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" event={"ID":"7889f8e7-2f27-434a-993a-6fec8c4cbba3","Type":"ContainerStarted","Data":"a3b72951a368853ca50a4969d62b266b5aca7af23fa5cdc4114845a0ee29418e"} Jul 13 03:05:05.545751 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:05.545710 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" event={"ID":"7889f8e7-2f27-434a-993a-6fec8c4cbba3","Type":"ContainerStarted","Data":"0b218d0f24030b962b2ad8e3c95e079e8c98e3cf74c65de2b122a24b539ff434"} Jul 13 03:05:06.552564 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:06.552528 2563 generic.go:356] "Generic (PLEG): container finished" podID="7889f8e7-2f27-434a-993a-6fec8c4cbba3" containerID="0b218d0f24030b962b2ad8e3c95e079e8c98e3cf74c65de2b122a24b539ff434" exitCode=0 Jul 13 03:05:06.552965 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:06.552618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" event={"ID":"7889f8e7-2f27-434a-993a-6fec8c4cbba3","Type":"ContainerDied","Data":"0b218d0f24030b962b2ad8e3c95e079e8c98e3cf74c65de2b122a24b539ff434"} Jul 13 03:05:07.559156 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:07.559111 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" event={"ID":"7889f8e7-2f27-434a-993a-6fec8c4cbba3","Type":"ContainerStarted","Data":"8022081ea292ea52985c9727b6c53d1e6a9b6874cfe6c6a0e3ab72d89f54edc5"} Jul 13 03:05:07.559563 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:07.559326 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:07.583285 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:07.583217 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" podStartSLOduration=2.138618074 podStartE2EDuration="6.583200319s" totalImagesPullingTime="3.399960749s" totalInitContainerRuntime="1.044621496s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:07.580481694 +0000 UTC m=+488.631288652" watchObservedRunningTime="2026-07-13 03:05:07.583200319 +0000 UTC m=+488.634007275" Jul 13 03:05:18.564827 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:18.564796 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp" Jul 13 03:05:28.504806 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.504766 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t"] Jul 13 03:05:28.509111 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.509086 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.513793 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.513760 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 03:05:28.513947 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.513760 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mr88t\"" Jul 13 03:05:28.513947 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.513772 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 03:05:28.513947 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.513848 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 03:05:28.513947 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.513896 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 03:05:28.514182 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.513901 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 03:05:28.520818 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.520791 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t"] Jul 13 03:05:28.583861 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.583820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa55733c-521e-4688-99d1-9cbd6bd01e4f-metrics-cert\") pod \"lws-controller-manager-f4bfdbc5d-vhw6t\" (UID: \"aa55733c-521e-4688-99d1-9cbd6bd01e4f\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.584105 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.583870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vcmq\" (UniqueName: \"kubernetes.io/projected/aa55733c-521e-4688-99d1-9cbd6bd01e4f-kube-api-access-8vcmq\") pod \"lws-controller-manager-f4bfdbc5d-vhw6t\" (UID: \"aa55733c-521e-4688-99d1-9cbd6bd01e4f\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.584105 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.583906 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa55733c-521e-4688-99d1-9cbd6bd01e4f-cert\") pod \"lws-controller-manager-f4bfdbc5d-vhw6t\" (UID: \"aa55733c-521e-4688-99d1-9cbd6bd01e4f\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.584105 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.584009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aa55733c-521e-4688-99d1-9cbd6bd01e4f-manager-config\") pod \"lws-controller-manager-f4bfdbc5d-vhw6t\" (UID: \"aa55733c-521e-4688-99d1-9cbd6bd01e4f\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.684653 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.684612 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa55733c-521e-4688-99d1-9cbd6bd01e4f-cert\") pod \"lws-controller-manager-f4bfdbc5d-vhw6t\" (UID: \"aa55733c-521e-4688-99d1-9cbd6bd01e4f\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.684831 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.684666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aa55733c-521e-4688-99d1-9cbd6bd01e4f-manager-config\") pod \"lws-controller-manager-f4bfdbc5d-vhw6t\" (UID: \"aa55733c-521e-4688-99d1-9cbd6bd01e4f\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.684831 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.684748 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa55733c-521e-4688-99d1-9cbd6bd01e4f-metrics-cert\") pod \"lws-controller-manager-f4bfdbc5d-vhw6t\" (UID: \"aa55733c-521e-4688-99d1-9cbd6bd01e4f\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.684831 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.684771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vcmq\" (UniqueName: \"kubernetes.io/projected/aa55733c-521e-4688-99d1-9cbd6bd01e4f-kube-api-access-8vcmq\") pod \"lws-controller-manager-f4bfdbc5d-vhw6t\" (UID: \"aa55733c-521e-4688-99d1-9cbd6bd01e4f\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.685442 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.685422 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aa55733c-521e-4688-99d1-9cbd6bd01e4f-manager-config\") pod \"lws-controller-manager-f4bfdbc5d-vhw6t\" (UID: \"aa55733c-521e-4688-99d1-9cbd6bd01e4f\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.687748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.687709 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa55733c-521e-4688-99d1-9cbd6bd01e4f-metrics-cert\") pod \"lws-controller-manager-f4bfdbc5d-vhw6t\" (UID: \"aa55733c-521e-4688-99d1-9cbd6bd01e4f\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.687748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.687739 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa55733c-521e-4688-99d1-9cbd6bd01e4f-cert\") pod \"lws-controller-manager-f4bfdbc5d-vhw6t\" (UID: \"aa55733c-521e-4688-99d1-9cbd6bd01e4f\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.703772 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.703735 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vcmq\" (UniqueName: \"kubernetes.io/projected/aa55733c-521e-4688-99d1-9cbd6bd01e4f-kube-api-access-8vcmq\") pod \"lws-controller-manager-f4bfdbc5d-vhw6t\" (UID: \"aa55733c-521e-4688-99d1-9cbd6bd01e4f\") " pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.820130 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.820035 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:28.982630 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:28.980021 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t"] Jul 13 03:05:28.988600 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:05:28.988566 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa55733c_521e_4688_99d1_9cbd6bd01e4f.slice/crio-b30fecbc85e7ddc15ceee5c541efcc62663eaf04bebe1557626eb0e68ea40530 WatchSource:0}: Error finding container b30fecbc85e7ddc15ceee5c541efcc62663eaf04bebe1557626eb0e68ea40530: Status 404 returned error can't find the container with id b30fecbc85e7ddc15ceee5c541efcc62663eaf04bebe1557626eb0e68ea40530 Jul 13 03:05:29.657903 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:29.657855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" event={"ID":"aa55733c-521e-4688-99d1-9cbd6bd01e4f","Type":"ContainerStarted","Data":"b30fecbc85e7ddc15ceee5c541efcc62663eaf04bebe1557626eb0e68ea40530"} Jul 13 03:05:31.565099 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.565062 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr"] Jul 13 03:05:31.569187 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.569132 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" Jul 13 03:05:31.572046 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.572007 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 13 03:05:31.572353 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.572332 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 13 03:05:31.573359 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.573335 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 03:05:31.573359 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.573351 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 03:05:31.573509 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.573399 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nqrgx\"" Jul 13 03:05:31.581108 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.581081 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr"] Jul 13 03:05:31.668650 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.668618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" event={"ID":"aa55733c-521e-4688-99d1-9cbd6bd01e4f","Type":"ContainerStarted","Data":"f4fdd4b5e2252411d942f1967b08a91e561e319ad4803ed244c4de0b75b793fb"} Jul 13 03:05:31.668831 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.668716 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:05:31.709821 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.709767 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" podStartSLOduration=1.278234171 podStartE2EDuration="3.709749325s" totalImagesPullingTime="2.431515154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:31.707921985 +0000 UTC m=+512.758728944" watchObservedRunningTime="2026-07-13 03:05:31.709749325 +0000 UTC m=+512.760556282" Jul 13 03:05:31.715860 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.715833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffce1075-7023-49f4-b091-7081254b2bfa-tls-certs\") pod \"kube-auth-proxy-7d889b4b4f-kngvr\" (UID: \"ffce1075-7023-49f4-b091-7081254b2bfa\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" Jul 13 03:05:31.715946 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.715898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffce1075-7023-49f4-b091-7081254b2bfa-tmp\") pod \"kube-auth-proxy-7d889b4b4f-kngvr\" (UID: \"ffce1075-7023-49f4-b091-7081254b2bfa\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" Jul 13 03:05:31.715946 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.715927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpvpc\" (UniqueName: \"kubernetes.io/projected/ffce1075-7023-49f4-b091-7081254b2bfa-kube-api-access-gpvpc\") pod \"kube-auth-proxy-7d889b4b4f-kngvr\" (UID: \"ffce1075-7023-49f4-b091-7081254b2bfa\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" Jul 13 03:05:31.817377 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.817340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffce1075-7023-49f4-b091-7081254b2bfa-tls-certs\") pod \"kube-auth-proxy-7d889b4b4f-kngvr\" (UID: \"ffce1075-7023-49f4-b091-7081254b2bfa\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" Jul 13 03:05:31.817584 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.817415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffce1075-7023-49f4-b091-7081254b2bfa-tmp\") pod \"kube-auth-proxy-7d889b4b4f-kngvr\" (UID: \"ffce1075-7023-49f4-b091-7081254b2bfa\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" Jul 13 03:05:31.817584 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.817443 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvpc\" (UniqueName: \"kubernetes.io/projected/ffce1075-7023-49f4-b091-7081254b2bfa-kube-api-access-gpvpc\") pod \"kube-auth-proxy-7d889b4b4f-kngvr\" (UID: \"ffce1075-7023-49f4-b091-7081254b2bfa\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" Jul 13 03:05:31.819830 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.819804 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffce1075-7023-49f4-b091-7081254b2bfa-tmp\") pod \"kube-auth-proxy-7d889b4b4f-kngvr\" (UID: \"ffce1075-7023-49f4-b091-7081254b2bfa\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" Jul 13 03:05:31.820164 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.820118 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffce1075-7023-49f4-b091-7081254b2bfa-tls-certs\") pod \"kube-auth-proxy-7d889b4b4f-kngvr\" (UID: \"ffce1075-7023-49f4-b091-7081254b2bfa\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" Jul 13 03:05:31.828866 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.828837 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpvpc\" (UniqueName: \"kubernetes.io/projected/ffce1075-7023-49f4-b091-7081254b2bfa-kube-api-access-gpvpc\") pod \"kube-auth-proxy-7d889b4b4f-kngvr\" (UID: \"ffce1075-7023-49f4-b091-7081254b2bfa\") " pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" Jul 13 03:05:31.880047 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:31.879854 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" Jul 13 03:05:32.046793 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:32.046761 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr"] Jul 13 03:05:32.049442 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:05:32.049415 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffce1075_7023_49f4_b091_7081254b2bfa.slice/crio-ab47b13ce1d7beb56b7e3eb071ce0bbcd57f5647f3ab92649062edc17bae4e75 WatchSource:0}: Error finding container ab47b13ce1d7beb56b7e3eb071ce0bbcd57f5647f3ab92649062edc17bae4e75: Status 404 returned error can't find the container with id ab47b13ce1d7beb56b7e3eb071ce0bbcd57f5647f3ab92649062edc17bae4e75 Jul 13 03:05:32.674206 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:32.674170 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" event={"ID":"ffce1075-7023-49f4-b091-7081254b2bfa","Type":"ContainerStarted","Data":"ab47b13ce1d7beb56b7e3eb071ce0bbcd57f5647f3ab92649062edc17bae4e75"} Jul 13 03:05:35.689518 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:35.689484 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" event={"ID":"ffce1075-7023-49f4-b091-7081254b2bfa","Type":"ContainerStarted","Data":"863164d260eef25c29fb2929be28fda4eed51be89320ded3bd684051ac36b4f1"} Jul 13 03:05:35.706152 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:35.706098 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d889b4b4f-kngvr" podStartSLOduration=1.8922118559999999 podStartE2EDuration="4.706058334s" totalImagesPullingTime="2.813846478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:05:35.705193129 +0000 UTC m=+516.756000091" watchObservedRunningTime="2026-07-13 03:05:35.706058334 +0000 UTC m=+516.756865290" Jul 13 03:05:42.676853 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:05:42.676817 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f4bfdbc5d-vhw6t" Jul 13 03:06:59.356769 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:06:59.356718 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:06:59.359787 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:06:59.359753 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:07:04.240720 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:04.240679 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd"] Jul 13 03:07:04.242975 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:04.242953 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd" Jul 13 03:07:04.245656 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:04.245627 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 03:07:04.245811 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:04.245627 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 03:07:04.246738 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:04.246715 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qznnk\"" Jul 13 03:07:04.252818 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:04.252790 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd"] Jul 13 03:07:04.355262 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:04.355219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b7qz\" (UniqueName: \"kubernetes.io/projected/d3798ce2-92a7-4641-8215-380236ee81ad-kube-api-access-4b7qz\") pod \"authorino-operator-75cc8d5cb7-lrpsd\" (UID: \"d3798ce2-92a7-4641-8215-380236ee81ad\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd" Jul 13 03:07:04.455861 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:04.455804 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b7qz\" (UniqueName: \"kubernetes.io/projected/d3798ce2-92a7-4641-8215-380236ee81ad-kube-api-access-4b7qz\") pod \"authorino-operator-75cc8d5cb7-lrpsd\" (UID: \"d3798ce2-92a7-4641-8215-380236ee81ad\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd" Jul 13 03:07:04.468394 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:04.468365 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b7qz\" (UniqueName: \"kubernetes.io/projected/d3798ce2-92a7-4641-8215-380236ee81ad-kube-api-access-4b7qz\") pod \"authorino-operator-75cc8d5cb7-lrpsd\" (UID: \"d3798ce2-92a7-4641-8215-380236ee81ad\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd" Jul 13 03:07:04.555073 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:04.554965 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd" Jul 13 03:07:04.699723 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:04.699699 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd"] Jul 13 03:07:04.702017 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:07:04.701987 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3798ce2_92a7_4641_8215_380236ee81ad.slice/crio-a5ad6da1687a0c4beb43287a35f4f35db5db46bb5c54db792207f327373cbffa WatchSource:0}: Error finding container a5ad6da1687a0c4beb43287a35f4f35db5db46bb5c54db792207f327373cbffa: Status 404 returned error can't find the container with id a5ad6da1687a0c4beb43287a35f4f35db5db46bb5c54db792207f327373cbffa Jul 13 03:07:05.101164 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:05.101097 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd" event={"ID":"d3798ce2-92a7-4641-8215-380236ee81ad","Type":"ContainerStarted","Data":"a5ad6da1687a0c4beb43287a35f4f35db5db46bb5c54db792207f327373cbffa"} Jul 13 03:07:07.112753 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:07.112709 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd" event={"ID":"d3798ce2-92a7-4641-8215-380236ee81ad","Type":"ContainerStarted","Data":"de49be7aad091b1f95298b99c4cf4096e7aeb7c8a83f46e8631443e17e27cc45"} Jul 13 03:07:07.113181 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:07.112785 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd" Jul 13 03:07:07.131439 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:07.131385 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd" podStartSLOduration=0.854172119 podStartE2EDuration="3.131369011s" totalImagesPullingTime="2.277196892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:07:07.130793481 +0000 UTC m=+608.181600440" watchObservedRunningTime="2026-07-13 03:07:07.131369011 +0000 UTC m=+608.182175967" Jul 13 03:07:18.120324 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:18.120292 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lrpsd" Jul 13 03:07:58.812157 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:58.812050 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-gprfn"] Jul 13 03:07:58.815632 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:58.815605 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gprfn" Jul 13 03:07:58.818000 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:58.817975 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-skdgg\"" Jul 13 03:07:58.822262 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:58.822236 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gprfn"] Jul 13 03:07:58.917536 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:58.917501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfqp5\" (UniqueName: \"kubernetes.io/projected/6be3f640-180c-43ec-be1a-68d85100074c-kube-api-access-rfqp5\") pod \"authorino-58cd955675-gprfn\" (UID: \"6be3f640-180c-43ec-be1a-68d85100074c\") " pod="kuadrant-system/authorino-58cd955675-gprfn" Jul 13 03:07:59.002035 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.001998 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-g4mmm"] Jul 13 03:07:59.005456 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.005437 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g4mmm" Jul 13 03:07:59.012277 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.012249 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g4mmm"] Jul 13 03:07:59.018124 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.018099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfqp5\" (UniqueName: \"kubernetes.io/projected/6be3f640-180c-43ec-be1a-68d85100074c-kube-api-access-rfqp5\") pod \"authorino-58cd955675-gprfn\" (UID: \"6be3f640-180c-43ec-be1a-68d85100074c\") " pod="kuadrant-system/authorino-58cd955675-gprfn" Jul 13 03:07:59.027058 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.027026 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfqp5\" (UniqueName: \"kubernetes.io/projected/6be3f640-180c-43ec-be1a-68d85100074c-kube-api-access-rfqp5\") pod \"authorino-58cd955675-gprfn\" (UID: \"6be3f640-180c-43ec-be1a-68d85100074c\") " pod="kuadrant-system/authorino-58cd955675-gprfn" Jul 13 03:07:59.119607 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.119512 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckgk9\" (UniqueName: \"kubernetes.io/projected/da076c06-b90c-44f2-b6fd-576a003defcf-kube-api-access-ckgk9\") pod \"authorino-75d556bd77-g4mmm\" (UID: \"da076c06-b90c-44f2-b6fd-576a003defcf\") " pod="kuadrant-system/authorino-75d556bd77-g4mmm" Jul 13 03:07:59.138434 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.138393 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gprfn" Jul 13 03:07:59.220206 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.220170 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckgk9\" (UniqueName: \"kubernetes.io/projected/da076c06-b90c-44f2-b6fd-576a003defcf-kube-api-access-ckgk9\") pod \"authorino-75d556bd77-g4mmm\" (UID: \"da076c06-b90c-44f2-b6fd-576a003defcf\") " pod="kuadrant-system/authorino-75d556bd77-g4mmm" Jul 13 03:07:59.230285 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.230201 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckgk9\" (UniqueName: \"kubernetes.io/projected/da076c06-b90c-44f2-b6fd-576a003defcf-kube-api-access-ckgk9\") pod \"authorino-75d556bd77-g4mmm\" (UID: \"da076c06-b90c-44f2-b6fd-576a003defcf\") " pod="kuadrant-system/authorino-75d556bd77-g4mmm" Jul 13 03:07:59.279220 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.279179 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gprfn"] Jul 13 03:07:59.282218 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:07:59.282186 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6be3f640_180c_43ec_be1a_68d85100074c.slice/crio-e716828f78bf740799e98b90b37a4d46b2fb5f3f8516e3b858018ddeb9381278 WatchSource:0}: Error finding container e716828f78bf740799e98b90b37a4d46b2fb5f3f8516e3b858018ddeb9381278: Status 404 returned error can't find the container with id e716828f78bf740799e98b90b37a4d46b2fb5f3f8516e3b858018ddeb9381278 Jul 13 03:07:59.316369 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.316323 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g4mmm" Jul 13 03:07:59.353089 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.353047 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gprfn" event={"ID":"6be3f640-180c-43ec-be1a-68d85100074c","Type":"ContainerStarted","Data":"e716828f78bf740799e98b90b37a4d46b2fb5f3f8516e3b858018ddeb9381278"} Jul 13 03:07:59.469599 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:07:59.469560 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda076c06_b90c_44f2_b6fd_576a003defcf.slice/crio-1b29a1d36fbf4ab22b0ff55fbfbd017b4a67ef70bc148be4cd5714f996d74cfb WatchSource:0}: Error finding container 1b29a1d36fbf4ab22b0ff55fbfbd017b4a67ef70bc148be4cd5714f996d74cfb: Status 404 returned error can't find the container with id 1b29a1d36fbf4ab22b0ff55fbfbd017b4a67ef70bc148be4cd5714f996d74cfb Jul 13 03:07:59.470712 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:07:59.470690 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g4mmm"] Jul 13 03:08:00.364826 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:00.364746 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g4mmm" event={"ID":"da076c06-b90c-44f2-b6fd-576a003defcf","Type":"ContainerStarted","Data":"1b29a1d36fbf4ab22b0ff55fbfbd017b4a67ef70bc148be4cd5714f996d74cfb"} Jul 13 03:08:03.391287 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:03.391181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gprfn" event={"ID":"6be3f640-180c-43ec-be1a-68d85100074c","Type":"ContainerStarted","Data":"0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565"} Jul 13 03:08:03.392775 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:03.392732 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g4mmm" event={"ID":"da076c06-b90c-44f2-b6fd-576a003defcf","Type":"ContainerStarted","Data":"e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb"} Jul 13 03:08:03.405834 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:03.405781 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-gprfn" podStartSLOduration=1.747073222 podStartE2EDuration="5.405763482s" totalImagesPullingTime="3.65869026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:08:03.405346427 +0000 UTC m=+664.456153387" watchObservedRunningTime="2026-07-13 03:08:03.405763482 +0000 UTC m=+664.456570480" Jul 13 03:08:03.421202 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:03.421129 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-g4mmm" podStartSLOduration=1.938211474 podStartE2EDuration="5.421109314s" totalImagesPullingTime="3.48289784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:08:03.418893756 +0000 UTC m=+664.469700712" watchObservedRunningTime="2026-07-13 03:08:03.421109314 +0000 UTC m=+664.471916272" Jul 13 03:08:03.448940 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:03.448901 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gprfn"] Jul 13 03:08:05.402829 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:05.402792 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-gprfn" podUID="6be3f640-180c-43ec-be1a-68d85100074c" containerName="authorino" containerID="cri-o://0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565" gracePeriod=30 Jul 13 03:08:05.656263 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:05.656194 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gprfn" Jul 13 03:08:05.785700 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:05.785655 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfqp5\" (UniqueName: \"kubernetes.io/projected/6be3f640-180c-43ec-be1a-68d85100074c-kube-api-access-rfqp5\") pod \"6be3f640-180c-43ec-be1a-68d85100074c\" (UID: \"6be3f640-180c-43ec-be1a-68d85100074c\") " Jul 13 03:08:05.788177 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:05.788101 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6be3f640-180c-43ec-be1a-68d85100074c-kube-api-access-rfqp5" (OuterVolumeSpecName: "kube-api-access-rfqp5") pod "6be3f640-180c-43ec-be1a-68d85100074c" (UID: "6be3f640-180c-43ec-be1a-68d85100074c"). InnerVolumeSpecName "kube-api-access-rfqp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:08:05.886822 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:05.886783 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfqp5\" (UniqueName: \"kubernetes.io/projected/6be3f640-180c-43ec-be1a-68d85100074c-kube-api-access-rfqp5\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:08:06.408472 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:06.408438 2563 generic.go:356] "Generic (PLEG): container finished" podID="6be3f640-180c-43ec-be1a-68d85100074c" containerID="0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565" exitCode=0 Jul 13 03:08:06.408935 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:06.408496 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gprfn" Jul 13 03:08:06.408935 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:06.408521 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gprfn" event={"ID":"6be3f640-180c-43ec-be1a-68d85100074c","Type":"ContainerDied","Data":"0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565"} Jul 13 03:08:06.408935 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:06.408567 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gprfn" event={"ID":"6be3f640-180c-43ec-be1a-68d85100074c","Type":"ContainerDied","Data":"e716828f78bf740799e98b90b37a4d46b2fb5f3f8516e3b858018ddeb9381278"} Jul 13 03:08:06.408935 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:06.408586 2563 scope.go:117] "RemoveContainer" containerID="0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565" Jul 13 03:08:06.417884 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:06.417861 2563 scope.go:117] "RemoveContainer" containerID="0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565" Jul 13 03:08:06.418219 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:08:06.418198 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565\": container with ID starting with 0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565 not found: ID does not exist" containerID="0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565" Jul 13 03:08:06.418279 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:06.418229 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565"} err="failed to get container status \"0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565\": rpc error: code = NotFound desc = could not find container \"0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565\": container with ID starting with 0c9911229f8ad75c209b74dc76db987e608326d5dd294e28a1110d610d64d565 not found: ID does not exist" Jul 13 03:08:06.431451 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:06.431415 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gprfn"] Jul 13 03:08:06.437194 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:06.437167 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-gprfn"] Jul 13 03:08:07.469044 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:07.469006 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6be3f640-180c-43ec-be1a-68d85100074c" path="/var/lib/kubelet/pods/6be3f640-180c-43ec-be1a-68d85100074c/volumes" Jul 13 03:08:27.862190 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:27.862135 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-glhs6"] Jul 13 03:08:27.862615 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:27.862554 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6be3f640-180c-43ec-be1a-68d85100074c" containerName="authorino" Jul 13 03:08:27.862615 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:27.862566 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6be3f640-180c-43ec-be1a-68d85100074c" containerName="authorino" Jul 13 03:08:27.862689 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:27.862635 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6be3f640-180c-43ec-be1a-68d85100074c" containerName="authorino" Jul 13 03:08:27.865771 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:27.865748 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-glhs6" Jul 13 03:08:27.872920 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:27.872885 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-glhs6"] Jul 13 03:08:27.988983 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:27.988935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-784p5\" (UniqueName: \"kubernetes.io/projected/4b2678d9-370d-429a-a3df-d0b53e301c68-kube-api-access-784p5\") pod \"authorino-5d4b67c446-glhs6\" (UID: \"4b2678d9-370d-429a-a3df-d0b53e301c68\") " pod="kuadrant-system/authorino-5d4b67c446-glhs6" Jul 13 03:08:28.049407 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.049370 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-glhs6"] Jul 13 03:08:28.049682 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:08:28.049658 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-784p5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-glhs6" podUID="4b2678d9-370d-429a-a3df-d0b53e301c68" Jul 13 03:08:28.078979 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.078945 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-tfl2x"] Jul 13 03:08:28.082525 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.082502 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-tfl2x" Jul 13 03:08:28.085248 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.085225 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 13 03:08:28.092701 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.092290 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-tfl2x"] Jul 13 03:08:28.092961 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.092930 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-784p5\" (UniqueName: \"kubernetes.io/projected/4b2678d9-370d-429a-a3df-d0b53e301c68-kube-api-access-784p5\") pod \"authorino-5d4b67c446-glhs6\" (UID: \"4b2678d9-370d-429a-a3df-d0b53e301c68\") " pod="kuadrant-system/authorino-5d4b67c446-glhs6" Jul 13 03:08:28.105590 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.105558 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-784p5\" (UniqueName: \"kubernetes.io/projected/4b2678d9-370d-429a-a3df-d0b53e301c68-kube-api-access-784p5\") pod \"authorino-5d4b67c446-glhs6\" (UID: \"4b2678d9-370d-429a-a3df-d0b53e301c68\") " pod="kuadrant-system/authorino-5d4b67c446-glhs6" Jul 13 03:08:28.124237 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.124129 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-tfl2x"] Jul 13 03:08:28.124457 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:08:28.124434 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zjlgl tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-tfl2x" podUID="21172f49-8ff2-408a-aff0-81a05a4da18c" Jul 13 03:08:28.156089 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.156050 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-656f95ffcf-vbhf8"] Jul 13 03:08:28.159651 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.159626 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-656f95ffcf-vbhf8" Jul 13 03:08:28.166753 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.166721 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-656f95ffcf-vbhf8"] Jul 13 03:08:28.194717 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.194673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21172f49-8ff2-408a-aff0-81a05a4da18c-tls-cert\") pod \"authorino-76877994-tfl2x\" (UID: \"21172f49-8ff2-408a-aff0-81a05a4da18c\") " pod="kuadrant-system/authorino-76877994-tfl2x" Jul 13 03:08:28.194935 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.194726 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjlgl\" (UniqueName: \"kubernetes.io/projected/21172f49-8ff2-408a-aff0-81a05a4da18c-kube-api-access-zjlgl\") pod \"authorino-76877994-tfl2x\" (UID: \"21172f49-8ff2-408a-aff0-81a05a4da18c\") " pod="kuadrant-system/authorino-76877994-tfl2x" Jul 13 03:08:28.296198 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.296117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p6h8\" (UniqueName: \"kubernetes.io/projected/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b-kube-api-access-5p6h8\") pod \"authorino-656f95ffcf-vbhf8\" (UID: \"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b\") " pod="kuadrant-system/authorino-656f95ffcf-vbhf8" Jul 13 03:08:28.296369 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.296213 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21172f49-8ff2-408a-aff0-81a05a4da18c-tls-cert\") pod \"authorino-76877994-tfl2x\" (UID: \"21172f49-8ff2-408a-aff0-81a05a4da18c\") " pod="kuadrant-system/authorino-76877994-tfl2x" Jul 13 03:08:28.296369 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.296255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjlgl\" (UniqueName: \"kubernetes.io/projected/21172f49-8ff2-408a-aff0-81a05a4da18c-kube-api-access-zjlgl\") pod \"authorino-76877994-tfl2x\" (UID: \"21172f49-8ff2-408a-aff0-81a05a4da18c\") " pod="kuadrant-system/authorino-76877994-tfl2x" Jul 13 03:08:28.296369 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.296289 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b-tls-cert\") pod \"authorino-656f95ffcf-vbhf8\" (UID: \"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b\") " pod="kuadrant-system/authorino-656f95ffcf-vbhf8" Jul 13 03:08:28.298846 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.298819 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21172f49-8ff2-408a-aff0-81a05a4da18c-tls-cert\") pod \"authorino-76877994-tfl2x\" (UID: \"21172f49-8ff2-408a-aff0-81a05a4da18c\") " pod="kuadrant-system/authorino-76877994-tfl2x" Jul 13 03:08:28.304418 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.304384 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjlgl\" (UniqueName: \"kubernetes.io/projected/21172f49-8ff2-408a-aff0-81a05a4da18c-kube-api-access-zjlgl\") pod \"authorino-76877994-tfl2x\" (UID: \"21172f49-8ff2-408a-aff0-81a05a4da18c\") " pod="kuadrant-system/authorino-76877994-tfl2x" Jul 13 03:08:28.397835 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.397741 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p6h8\" (UniqueName: \"kubernetes.io/projected/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b-kube-api-access-5p6h8\") pod \"authorino-656f95ffcf-vbhf8\" (UID: \"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b\") " pod="kuadrant-system/authorino-656f95ffcf-vbhf8" Jul 13 03:08:28.397835 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.397827 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b-tls-cert\") pod \"authorino-656f95ffcf-vbhf8\" (UID: \"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b\") " pod="kuadrant-system/authorino-656f95ffcf-vbhf8" Jul 13 03:08:28.400654 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.400626 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b-tls-cert\") pod \"authorino-656f95ffcf-vbhf8\" (UID: \"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b\") " pod="kuadrant-system/authorino-656f95ffcf-vbhf8" Jul 13 03:08:28.406007 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.405982 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p6h8\" (UniqueName: \"kubernetes.io/projected/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b-kube-api-access-5p6h8\") pod \"authorino-656f95ffcf-vbhf8\" (UID: \"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b\") " pod="kuadrant-system/authorino-656f95ffcf-vbhf8" Jul 13 03:08:28.471018 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.470979 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-656f95ffcf-vbhf8" Jul 13 03:08:28.517112 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.517078 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-tfl2x" Jul 13 03:08:28.517112 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.517094 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-glhs6" Jul 13 03:08:28.525262 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.525127 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-tfl2x" Jul 13 03:08:28.530607 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.530561 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-glhs6" Jul 13 03:08:28.615776 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.615735 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-656f95ffcf-vbhf8"] Jul 13 03:08:28.619005 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:08:28.618980 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7f26d40_2da5_4aa8_b114_89aa4aa8bd3b.slice/crio-135abe77ca99b5e69acf92be9c66beeb7c5230278344c48b52a6b63e6baa5e26 WatchSource:0}: Error finding container 135abe77ca99b5e69acf92be9c66beeb7c5230278344c48b52a6b63e6baa5e26: Status 404 returned error can't find the container with id 135abe77ca99b5e69acf92be9c66beeb7c5230278344c48b52a6b63e6baa5e26 Jul 13 03:08:28.700466 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.700427 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21172f49-8ff2-408a-aff0-81a05a4da18c-tls-cert\") pod \"21172f49-8ff2-408a-aff0-81a05a4da18c\" (UID: \"21172f49-8ff2-408a-aff0-81a05a4da18c\") " Jul 13 03:08:28.700636 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.700494 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-784p5\" (UniqueName: \"kubernetes.io/projected/4b2678d9-370d-429a-a3df-d0b53e301c68-kube-api-access-784p5\") pod \"4b2678d9-370d-429a-a3df-d0b53e301c68\" (UID: \"4b2678d9-370d-429a-a3df-d0b53e301c68\") " Jul 13 03:08:28.700636 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.700524 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjlgl\" (UniqueName: \"kubernetes.io/projected/21172f49-8ff2-408a-aff0-81a05a4da18c-kube-api-access-zjlgl\") pod \"21172f49-8ff2-408a-aff0-81a05a4da18c\" (UID: \"21172f49-8ff2-408a-aff0-81a05a4da18c\") " Jul 13 03:08:28.702813 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.702776 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21172f49-8ff2-408a-aff0-81a05a4da18c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "21172f49-8ff2-408a-aff0-81a05a4da18c" (UID: "21172f49-8ff2-408a-aff0-81a05a4da18c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:08:28.702955 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.702810 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21172f49-8ff2-408a-aff0-81a05a4da18c-kube-api-access-zjlgl" (OuterVolumeSpecName: "kube-api-access-zjlgl") pod "21172f49-8ff2-408a-aff0-81a05a4da18c" (UID: "21172f49-8ff2-408a-aff0-81a05a4da18c"). InnerVolumeSpecName "kube-api-access-zjlgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:08:28.702955 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.702814 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b2678d9-370d-429a-a3df-d0b53e301c68-kube-api-access-784p5" (OuterVolumeSpecName: "kube-api-access-784p5") pod "4b2678d9-370d-429a-a3df-d0b53e301c68" (UID: "4b2678d9-370d-429a-a3df-d0b53e301c68"). InnerVolumeSpecName "kube-api-access-784p5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:08:28.801697 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.801638 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/21172f49-8ff2-408a-aff0-81a05a4da18c-tls-cert\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:08:28.801697 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.801688 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-784p5\" (UniqueName: \"kubernetes.io/projected/4b2678d9-370d-429a-a3df-d0b53e301c68-kube-api-access-784p5\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:08:28.801697 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:28.801701 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjlgl\" (UniqueName: \"kubernetes.io/projected/21172f49-8ff2-408a-aff0-81a05a4da18c-kube-api-access-zjlgl\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:08:29.524727 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:29.524677 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-656f95ffcf-vbhf8" event={"ID":"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b","Type":"ContainerStarted","Data":"eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed"} Jul 13 03:08:29.525347 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:29.524743 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-656f95ffcf-vbhf8" event={"ID":"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b","Type":"ContainerStarted","Data":"135abe77ca99b5e69acf92be9c66beeb7c5230278344c48b52a6b63e6baa5e26"} Jul 13 03:08:29.525347 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:29.524859 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-tfl2x" Jul 13 03:08:29.525347 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:29.524960 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-glhs6" Jul 13 03:08:29.541732 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:29.541670 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-656f95ffcf-vbhf8" podStartSLOduration=1.123868144 podStartE2EDuration="1.541652823s" totalImagesPullingTime="417.784679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:08:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:08:29.539367688 +0000 UTC m=+690.590174645" watchObservedRunningTime="2026-07-13 03:08:29.541652823 +0000 UTC m=+690.592459804" Jul 13 03:08:29.563350 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:29.563315 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-glhs6"] Jul 13 03:08:29.569132 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:29.569103 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g4mmm"] Jul 13 03:08:29.569382 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:29.569315 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-g4mmm" podUID="da076c06-b90c-44f2-b6fd-576a003defcf" containerName="authorino" containerID="cri-o://e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb" gracePeriod=30 Jul 13 03:08:29.571751 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:29.571727 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-glhs6"] Jul 13 03:08:29.594611 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:29.594576 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-tfl2x"] Jul 13 03:08:29.602852 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:29.602822 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-tfl2x"] Jul 13 03:08:29.822656 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:29.822627 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g4mmm" Jul 13 03:08:30.012060 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:30.011957 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckgk9\" (UniqueName: \"kubernetes.io/projected/da076c06-b90c-44f2-b6fd-576a003defcf-kube-api-access-ckgk9\") pod \"da076c06-b90c-44f2-b6fd-576a003defcf\" (UID: \"da076c06-b90c-44f2-b6fd-576a003defcf\") " Jul 13 03:08:30.014344 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:30.014310 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da076c06-b90c-44f2-b6fd-576a003defcf-kube-api-access-ckgk9" (OuterVolumeSpecName: "kube-api-access-ckgk9") pod "da076c06-b90c-44f2-b6fd-576a003defcf" (UID: "da076c06-b90c-44f2-b6fd-576a003defcf"). InnerVolumeSpecName "kube-api-access-ckgk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:08:30.113075 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:30.113033 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckgk9\" (UniqueName: \"kubernetes.io/projected/da076c06-b90c-44f2-b6fd-576a003defcf-kube-api-access-ckgk9\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:08:30.530341 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:30.530297 2563 generic.go:356] "Generic (PLEG): container finished" podID="da076c06-b90c-44f2-b6fd-576a003defcf" containerID="e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb" exitCode=0 Jul 13 03:08:30.530341 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:30.530340 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g4mmm" Jul 13 03:08:30.530806 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:30.530387 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g4mmm" event={"ID":"da076c06-b90c-44f2-b6fd-576a003defcf","Type":"ContainerDied","Data":"e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb"} Jul 13 03:08:30.530806 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:30.530430 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g4mmm" event={"ID":"da076c06-b90c-44f2-b6fd-576a003defcf","Type":"ContainerDied","Data":"1b29a1d36fbf4ab22b0ff55fbfbd017b4a67ef70bc148be4cd5714f996d74cfb"} Jul 13 03:08:30.530806 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:30.530451 2563 scope.go:117] "RemoveContainer" containerID="e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb" Jul 13 03:08:30.539738 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:30.539718 2563 scope.go:117] "RemoveContainer" containerID="e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb" Jul 13 03:08:30.540056 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:08:30.540037 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb\": container with ID starting with e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb not found: ID does not exist" containerID="e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb" Jul 13 03:08:30.540126 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:30.540068 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb"} err="failed to get container status \"e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb\": rpc error: code = NotFound desc = could not find container \"e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb\": container with ID starting with e116a8186d5ff944be5c6caffa078c8fe436c4edac4a4a333c9075089390dfcb not found: ID does not exist" Jul 13 03:08:30.553323 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:30.553272 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g4mmm"] Jul 13 03:08:30.555332 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:30.555307 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g4mmm"] Jul 13 03:08:31.469267 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:31.469229 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21172f49-8ff2-408a-aff0-81a05a4da18c" path="/var/lib/kubelet/pods/21172f49-8ff2-408a-aff0-81a05a4da18c/volumes" Jul 13 03:08:31.469492 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:31.469479 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b2678d9-370d-429a-a3df-d0b53e301c68" path="/var/lib/kubelet/pods/4b2678d9-370d-429a-a3df-d0b53e301c68/volumes" Jul 13 03:08:31.469679 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:08:31.469668 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da076c06-b90c-44f2-b6fd-576a003defcf" path="/var/lib/kubelet/pods/da076c06-b90c-44f2-b6fd-576a003defcf/volumes" Jul 13 03:09:37.938800 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:37.938761 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz"] Jul 13 03:09:37.939313 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:37.939123 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da076c06-b90c-44f2-b6fd-576a003defcf" containerName="authorino" Jul 13 03:09:37.939313 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:37.939134 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da076c06-b90c-44f2-b6fd-576a003defcf" containerName="authorino" Jul 13 03:09:37.939313 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:37.939218 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="da076c06-b90c-44f2-b6fd-576a003defcf" containerName="authorino" Jul 13 03:09:37.941362 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:37.941346 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:37.944055 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:37.944029 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 03:09:37.944218 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:37.944035 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 03:09:37.945182 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:37.945156 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-85pt7\"" Jul 13 03:09:37.945274 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:37.945196 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 13 03:09:37.949936 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:37.949914 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz"] Jul 13 03:09:38.046557 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.046513 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.046557 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.046555 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.046776 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.046645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.046776 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.046695 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.046776 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.046719 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mb44\" (UniqueName: \"kubernetes.io/projected/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-kube-api-access-5mb44\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.046776 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.046745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.147444 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.147404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.147444 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.147447 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.147672 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.147503 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.147672 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.147553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.147741 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.147686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mb44\" (UniqueName: \"kubernetes.io/projected/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-kube-api-access-5mb44\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.147785 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.147735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.147910 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.147888 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.147998 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.147931 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.147998 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.147948 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.150005 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.149981 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.150369 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.150347 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.156272 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.156246 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mb44\" (UniqueName: \"kubernetes.io/projected/2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd-kube-api-access-5mb44\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bjvwz\" (UID: \"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.253788 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.253686 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:38.394568 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.394542 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz"] Jul 13 03:09:38.397241 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:09:38.397204 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff6fb54_84c7_489d_9f3f_0d9814ebcbfd.slice/crio-6c94dd888fca673fb9be5666b10f3c308a9c889802241a8ea2d241ad8edab321 WatchSource:0}: Error finding container 6c94dd888fca673fb9be5666b10f3c308a9c889802241a8ea2d241ad8edab321: Status 404 returned error can't find the container with id 6c94dd888fca673fb9be5666b10f3c308a9c889802241a8ea2d241ad8edab321 Jul 13 03:09:38.870874 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:38.870828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" event={"ID":"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd","Type":"ContainerStarted","Data":"6c94dd888fca673fb9be5666b10f3c308a9c889802241a8ea2d241ad8edab321"} Jul 13 03:09:39.883631 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:39.883514 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" event={"ID":"2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd","Type":"ContainerStarted","Data":"27fff12ffd1a895f4b982333c020973c1dcecb51d70b3eb7e7f8c18d6fb3b235"} Jul 13 03:09:39.905038 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:39.904975 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" podStartSLOduration=1.767471054 podStartE2EDuration="2.904959182s" totalImagesPullingTime="1.137488128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:09:39.903221436 +0000 UTC m=+760.954028397" watchObservedRunningTime="2026-07-13 03:09:39.904959182 +0000 UTC m=+760.955766154" Jul 13 03:09:48.254061 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:48.254000 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:48.254544 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:48.254084 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:48.266983 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:48.266950 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:48.937201 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:48.937170 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bjvwz" Jul 13 03:09:54.634766 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.634726 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd"] Jul 13 03:09:54.638168 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.638113 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.640674 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.640645 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 13 03:09:54.648524 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.648497 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd"] Jul 13 03:09:54.710252 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.710217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b123f0b-86c6-44a5-94b1-519a0c342f36-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.710448 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.710266 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b123f0b-86c6-44a5-94b1-519a0c342f36-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.710448 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.710331 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b123f0b-86c6-44a5-94b1-519a0c342f36-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.710448 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.710362 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw6fn\" (UniqueName: \"kubernetes.io/projected/5b123f0b-86c6-44a5-94b1-519a0c342f36-kube-api-access-tw6fn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.710448 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.710392 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b123f0b-86c6-44a5-94b1-519a0c342f36-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.710448 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.710415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b123f0b-86c6-44a5-94b1-519a0c342f36-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.811563 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.811522 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b123f0b-86c6-44a5-94b1-519a0c342f36-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.811772 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.811587 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b123f0b-86c6-44a5-94b1-519a0c342f36-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.811772 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.811627 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b123f0b-86c6-44a5-94b1-519a0c342f36-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.811772 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.811649 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw6fn\" (UniqueName: \"kubernetes.io/projected/5b123f0b-86c6-44a5-94b1-519a0c342f36-kube-api-access-tw6fn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.811772 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.811689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b123f0b-86c6-44a5-94b1-519a0c342f36-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.811772 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.811723 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b123f0b-86c6-44a5-94b1-519a0c342f36-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.812110 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.812075 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b123f0b-86c6-44a5-94b1-519a0c342f36-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.812110 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.812095 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b123f0b-86c6-44a5-94b1-519a0c342f36-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.812477 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.812302 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b123f0b-86c6-44a5-94b1-519a0c342f36-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.814091 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.814059 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b123f0b-86c6-44a5-94b1-519a0c342f36-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.814227 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.814173 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b123f0b-86c6-44a5-94b1-519a0c342f36-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.819402 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.819376 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw6fn\" (UniqueName: \"kubernetes.io/projected/5b123f0b-86c6-44a5-94b1-519a0c342f36-kube-api-access-tw6fn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd\" (UID: \"5b123f0b-86c6-44a5-94b1-519a0c342f36\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:54.950388 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:54.950348 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:09:55.092744 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:55.092713 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd"] Jul 13 03:09:55.095117 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:09:55.095089 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b123f0b_86c6_44a5_94b1_519a0c342f36.slice/crio-dd2485ec826b5a5e67e9595d95a7d47b3178b8b864e2593146aafff523753ef3 WatchSource:0}: Error finding container dd2485ec826b5a5e67e9595d95a7d47b3178b8b864e2593146aafff523753ef3: Status 404 returned error can't find the container with id dd2485ec826b5a5e67e9595d95a7d47b3178b8b864e2593146aafff523753ef3 Jul 13 03:09:55.958481 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:55.958443 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" event={"ID":"5b123f0b-86c6-44a5-94b1-519a0c342f36","Type":"ContainerStarted","Data":"da7ebea0e54682630106da6bdc9514b72ab29e8570e050dbb6c1d4028fe1a352"} Jul 13 03:09:55.958868 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:55.958498 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" event={"ID":"5b123f0b-86c6-44a5-94b1-519a0c342f36","Type":"ContainerStarted","Data":"dd2485ec826b5a5e67e9595d95a7d47b3178b8b864e2593146aafff523753ef3"} Jul 13 03:09:55.977259 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:09:55.977199 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" podStartSLOduration=1.7828605739999999 podStartE2EDuration="1.977181034s" totalImagesPullingTime="194.32046ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:09:55.975003842 +0000 UTC m=+777.025810796" watchObservedRunningTime="2026-07-13 03:09:55.977181034 +0000 UTC m=+777.027987991" Jul 13 03:10:04.950632 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:04.950595 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:10:04.951125 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:04.950687 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:10:04.963305 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:04.963273 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:10:05.013248 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:05.013220 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd" Jul 13 03:10:19.330771 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.330723 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2"] Jul 13 03:10:19.336589 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.336564 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.339401 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.339374 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 13 03:10:19.344369 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.344324 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2"] Jul 13 03:10:19.451873 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.451829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33d62490-f7af-4bef-a8b6-06e9011b13f2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.452084 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.451885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33d62490-f7af-4bef-a8b6-06e9011b13f2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.452084 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.451954 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d62490-f7af-4bef-a8b6-06e9011b13f2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.452084 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.452018 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33d62490-f7af-4bef-a8b6-06e9011b13f2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.452084 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.452043 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7r2m\" (UniqueName: \"kubernetes.io/projected/33d62490-f7af-4bef-a8b6-06e9011b13f2-kube-api-access-m7r2m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.452316 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.452110 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33d62490-f7af-4bef-a8b6-06e9011b13f2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.553415 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.553333 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33d62490-f7af-4bef-a8b6-06e9011b13f2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.553415 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.553381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33d62490-f7af-4bef-a8b6-06e9011b13f2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.553415 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.553414 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d62490-f7af-4bef-a8b6-06e9011b13f2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.553766 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.553471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33d62490-f7af-4bef-a8b6-06e9011b13f2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.553766 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.553509 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7r2m\" (UniqueName: \"kubernetes.io/projected/33d62490-f7af-4bef-a8b6-06e9011b13f2-kube-api-access-m7r2m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.553766 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.553571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33d62490-f7af-4bef-a8b6-06e9011b13f2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.553926 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.553823 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33d62490-f7af-4bef-a8b6-06e9011b13f2-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.553926 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.553893 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33d62490-f7af-4bef-a8b6-06e9011b13f2-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.554023 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.553978 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33d62490-f7af-4bef-a8b6-06e9011b13f2-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.556204 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.556181 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33d62490-f7af-4bef-a8b6-06e9011b13f2-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.556519 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.556497 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33d62490-f7af-4bef-a8b6-06e9011b13f2-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.564434 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.564406 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7r2m\" (UniqueName: \"kubernetes.io/projected/33d62490-f7af-4bef-a8b6-06e9011b13f2-kube-api-access-m7r2m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2\" (UID: \"33d62490-f7af-4bef-a8b6-06e9011b13f2\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.649261 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.649128 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:19.807475 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.807450 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2"] Jul 13 03:10:19.810825 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:10:19.810792 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33d62490_f7af_4bef_a8b6_06e9011b13f2.slice/crio-ed0ef439be8492a07bab08b8ecdc2b2136c86958968c994425ebcaa534a0f776 WatchSource:0}: Error finding container ed0ef439be8492a07bab08b8ecdc2b2136c86958968c994425ebcaa534a0f776: Status 404 returned error can't find the container with id ed0ef439be8492a07bab08b8ecdc2b2136c86958968c994425ebcaa534a0f776 Jul 13 03:10:19.812349 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:19.812328 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 03:10:20.074768 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:20.074732 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" event={"ID":"33d62490-f7af-4bef-a8b6-06e9011b13f2","Type":"ContainerStarted","Data":"7b49cd568a64ded5181a8a85f2540c8c08a6fe1bf7bd2af9911b786309ccea7e"} Jul 13 03:10:20.074959 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:20.074778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" event={"ID":"33d62490-f7af-4bef-a8b6-06e9011b13f2","Type":"ContainerStarted","Data":"ed0ef439be8492a07bab08b8ecdc2b2136c86958968c994425ebcaa534a0f776"} Jul 13 03:10:20.092470 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:20.092404 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" podStartSLOduration=0.906147093 podStartE2EDuration="1.09238053s" totalImagesPullingTime="186.233437ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:10:20.091853672 +0000 UTC m=+801.142660644" watchObservedRunningTime="2026-07-13 03:10:20.09238053 +0000 UTC m=+801.143187489" Jul 13 03:10:29.650196 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:29.650124 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:29.650196 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:29.650204 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:29.663094 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:29.663060 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:10:30.137849 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:10:30.137819 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2" Jul 13 03:11:18.101413 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:18.101373 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b6d4464cd-wg9bm"] Jul 13 03:11:18.105040 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:18.105018 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6d4464cd-wg9bm" Jul 13 03:11:18.111187 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:18.111133 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6d4464cd-wg9bm"] Jul 13 03:11:18.207736 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:18.207694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdm9k\" (UniqueName: \"kubernetes.io/projected/b94f2a38-d5fd-4e14-8863-d37fb0fd9d69-kube-api-access-jdm9k\") pod \"authorino-b6d4464cd-wg9bm\" (UID: \"b94f2a38-d5fd-4e14-8863-d37fb0fd9d69\") " pod="kuadrant-system/authorino-b6d4464cd-wg9bm" Jul 13 03:11:18.207736 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:18.207743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b94f2a38-d5fd-4e14-8863-d37fb0fd9d69-tls-cert\") pod \"authorino-b6d4464cd-wg9bm\" (UID: \"b94f2a38-d5fd-4e14-8863-d37fb0fd9d69\") " pod="kuadrant-system/authorino-b6d4464cd-wg9bm" Jul 13 03:11:18.308910 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:18.308870 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdm9k\" (UniqueName: \"kubernetes.io/projected/b94f2a38-d5fd-4e14-8863-d37fb0fd9d69-kube-api-access-jdm9k\") pod \"authorino-b6d4464cd-wg9bm\" (UID: \"b94f2a38-d5fd-4e14-8863-d37fb0fd9d69\") " pod="kuadrant-system/authorino-b6d4464cd-wg9bm" Jul 13 03:11:18.309115 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:18.308920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b94f2a38-d5fd-4e14-8863-d37fb0fd9d69-tls-cert\") pod \"authorino-b6d4464cd-wg9bm\" (UID: \"b94f2a38-d5fd-4e14-8863-d37fb0fd9d69\") " pod="kuadrant-system/authorino-b6d4464cd-wg9bm" Jul 13 03:11:18.311672 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:18.311644 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b94f2a38-d5fd-4e14-8863-d37fb0fd9d69-tls-cert\") pod \"authorino-b6d4464cd-wg9bm\" (UID: \"b94f2a38-d5fd-4e14-8863-d37fb0fd9d69\") " pod="kuadrant-system/authorino-b6d4464cd-wg9bm" Jul 13 03:11:18.316689 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:18.316661 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdm9k\" (UniqueName: \"kubernetes.io/projected/b94f2a38-d5fd-4e14-8863-d37fb0fd9d69-kube-api-access-jdm9k\") pod \"authorino-b6d4464cd-wg9bm\" (UID: \"b94f2a38-d5fd-4e14-8863-d37fb0fd9d69\") " pod="kuadrant-system/authorino-b6d4464cd-wg9bm" Jul 13 03:11:18.415803 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:18.415707 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6d4464cd-wg9bm" Jul 13 03:11:18.556247 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:18.556220 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6d4464cd-wg9bm"] Jul 13 03:11:18.559000 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:11:18.558972 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb94f2a38_d5fd_4e14_8863_d37fb0fd9d69.slice/crio-e8894b40c865f2883a8f02298a667628f06ab43cf852c18e7411947295e3cdae WatchSource:0}: Error finding container e8894b40c865f2883a8f02298a667628f06ab43cf852c18e7411947295e3cdae: Status 404 returned error can't find the container with id e8894b40c865f2883a8f02298a667628f06ab43cf852c18e7411947295e3cdae Jul 13 03:11:19.375221 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:19.375106 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6d4464cd-wg9bm" event={"ID":"b94f2a38-d5fd-4e14-8863-d37fb0fd9d69","Type":"ContainerStarted","Data":"bb744e64151f8d0dde7815381d7af6497b7cdb4c8e9adf1423c96b9c677c36ae"} Jul 13 03:11:19.375221 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:19.375186 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6d4464cd-wg9bm" event={"ID":"b94f2a38-d5fd-4e14-8863-d37fb0fd9d69","Type":"ContainerStarted","Data":"e8894b40c865f2883a8f02298a667628f06ab43cf852c18e7411947295e3cdae"} Jul 13 03:11:19.399345 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:19.399293 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b6d4464cd-wg9bm" podStartSLOduration=1.003142261 podStartE2EDuration="1.399273981s" totalImagesPullingTime="396.13172ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:11:19.398346527 +0000 UTC m=+860.449153485" watchObservedRunningTime="2026-07-13 03:11:19.399273981 +0000 UTC m=+860.450080937" Jul 13 03:11:19.433962 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:19.433525 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-656f95ffcf-vbhf8"] Jul 13 03:11:19.434308 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:19.433756 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-656f95ffcf-vbhf8" podUID="c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b" containerName="authorino" containerID="cri-o://eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed" gracePeriod=30 Jul 13 03:11:19.716047 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:19.716015 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-656f95ffcf-vbhf8" Jul 13 03:11:19.824032 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:19.823994 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p6h8\" (UniqueName: \"kubernetes.io/projected/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b-kube-api-access-5p6h8\") pod \"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b\" (UID: \"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b\") " Jul 13 03:11:19.824253 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:19.824052 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b-tls-cert\") pod \"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b\" (UID: \"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b\") " Jul 13 03:11:19.826480 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:19.826411 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b-kube-api-access-5p6h8" (OuterVolumeSpecName: "kube-api-access-5p6h8") pod "c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b" (UID: "c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b"). InnerVolumeSpecName "kube-api-access-5p6h8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:11:19.839097 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:19.839060 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b" (UID: "c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:11:19.925073 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:19.924976 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p6h8\" (UniqueName: \"kubernetes.io/projected/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b-kube-api-access-5p6h8\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:11:19.925073 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:19.925013 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b-tls-cert\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:11:20.382469 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:20.382430 2563 generic.go:356] "Generic (PLEG): container finished" podID="c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b" containerID="eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed" exitCode=0 Jul 13 03:11:20.382915 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:20.382476 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-656f95ffcf-vbhf8" event={"ID":"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b","Type":"ContainerDied","Data":"eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed"} Jul 13 03:11:20.382915 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:20.382523 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-656f95ffcf-vbhf8" event={"ID":"c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b","Type":"ContainerDied","Data":"135abe77ca99b5e69acf92be9c66beeb7c5230278344c48b52a6b63e6baa5e26"} Jul 13 03:11:20.382915 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:20.382540 2563 scope.go:117] "RemoveContainer" containerID="eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed" Jul 13 03:11:20.382915 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:20.382488 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-656f95ffcf-vbhf8" Jul 13 03:11:20.391986 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:20.391960 2563 scope.go:117] "RemoveContainer" containerID="eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed" Jul 13 03:11:20.392322 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:11:20.392295 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed\": container with ID starting with eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed not found: ID does not exist" containerID="eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed" Jul 13 03:11:20.392414 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:20.392332 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed"} err="failed to get container status \"eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed\": rpc error: code = NotFound desc = could not find container \"eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed\": container with ID starting with eec61ca699544bcb55741df208733d78f9bf79c716f44188a3c7f0c3cd2fd9ed not found: ID does not exist" Jul 13 03:11:20.407897 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:20.407868 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-656f95ffcf-vbhf8"] Jul 13 03:11:20.412103 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:20.412074 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-656f95ffcf-vbhf8"] Jul 13 03:11:21.468497 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:21.468462 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b" path="/var/lib/kubelet/pods/c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b/volumes" Jul 13 03:11:59.387349 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:59.387318 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:11:59.391625 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:11:59.391594 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:16:59.428593 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:16:59.428563 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:16:59.431229 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:16:59.431200 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:21:59.458352 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:21:59.458320 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:21:59.462096 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:21:59.462069 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:26:59.488092 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:26:59.488063 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:26:59.494117 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:26:59.494093 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:31:59.525704 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:31:59.525674 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:31:59.533571 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:31:59.533542 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:36:52.529927 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.529889 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l"] Jul 13 03:36:52.530458 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.530320 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b" containerName="authorino" Jul 13 03:36:52.530458 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.530333 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b" containerName="authorino" Jul 13 03:36:52.530458 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.530402 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7f26d40-2da5-4aa8-b114-89aa4aa8bd3b" containerName="authorino" Jul 13 03:36:52.533134 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.533115 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.535720 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.535692 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-766a483d\"/\"openshift-service-ca.crt\"" Jul 13 03:36:52.535862 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.535692 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-766a483d\"/\"default-dockercfg-njmvd\"" Jul 13 03:36:52.535862 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.535694 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-766a483d\"/\"kube-root-ca.crt\"" Jul 13 03:36:52.536729 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.536706 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-766a483d\"/\"e2e-lifecycle-model-766a483d-kserve-self-signed-certs\"" Jul 13 03:36:52.542377 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.542351 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l"] Jul 13 03:36:52.628526 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.628472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-tmp-dir\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.628526 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.628533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-home\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.628764 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.628617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-tls-certs\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.628764 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.628651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-dshm\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.628764 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.628668 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-model-cache\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.628764 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.628721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chgqk\" (UniqueName: \"kubernetes.io/projected/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-kube-api-access-chgqk\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.729832 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.729771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-tls-certs\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.729832 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.729833 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-dshm\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.730113 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.729860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-model-cache\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.730113 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.729897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chgqk\" (UniqueName: \"kubernetes.io/projected/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-kube-api-access-chgqk\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.730113 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.729958 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-tmp-dir\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.730113 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.729981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-home\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.730470 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.730436 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-home\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.730519 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.730471 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-tmp-dir\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.730567 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.730518 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-model-cache\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.732383 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.732356 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-dshm\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.732689 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.732660 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-tls-certs\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.737759 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.737737 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chgqk\" (UniqueName: \"kubernetes.io/projected/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-kube-api-access-chgqk\") pod \"e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.844067 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.843973 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:36:52.987501 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:52.987471 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l"] Jul 13 03:36:52.990513 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:36:52.990482 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4676ec8d_4f05_47e5_8c47_cee09b0cf2f1.slice/crio-1c4a1b7e458492f00cf0dc6e8d91622ac29c23c81cccd5cdb4c939b72442cc4f WatchSource:0}: Error finding container 1c4a1b7e458492f00cf0dc6e8d91622ac29c23c81cccd5cdb4c939b72442cc4f: Status 404 returned error can't find the container with id 1c4a1b7e458492f00cf0dc6e8d91622ac29c23c81cccd5cdb4c939b72442cc4f Jul 13 03:36:53.848419 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:53.848383 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" event={"ID":"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1","Type":"ContainerStarted","Data":"2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb"} Jul 13 03:36:53.848419 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:53.848425 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" event={"ID":"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1","Type":"ContainerStarted","Data":"1c4a1b7e458492f00cf0dc6e8d91622ac29c23c81cccd5cdb4c939b72442cc4f"} Jul 13 03:36:53.865081 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:53.865023 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" podStartSLOduration=1.865006074 podStartE2EDuration="1.865006074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:36:53.862766931 +0000 UTC m=+2394.913573889" watchObservedRunningTime="2026-07-13 03:36:53.865006074 +0000 UTC m=+2394.915813031" Jul 13 03:36:59.558015 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:59.557981 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:36:59.572417 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:36:59.572389 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:37:02.844720 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:02.844674 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:37:02.844720 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:02.844729 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:37:02.857283 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:02.857246 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:37:02.902787 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:02.902756 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:37:17.956464 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:17.956422 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l"] Jul 13 03:37:32.978553 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:32.978430 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" podUID="4676ec8d-4f05-47e5-8c47-cee09b0cf2f1" containerName="main" containerID="cri-o://2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb" gracePeriod=45 Jul 13 03:37:33.237527 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.237458 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:37:33.326949 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.326903 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-tmp-dir\") pod \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " Jul 13 03:37:33.327222 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.326966 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chgqk\" (UniqueName: \"kubernetes.io/projected/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-kube-api-access-chgqk\") pod \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " Jul 13 03:37:33.327222 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.326983 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-model-cache\") pod \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " Jul 13 03:37:33.327222 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.327072 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-tls-certs\") pod \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " Jul 13 03:37:33.327409 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.327219 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-dshm\") pod \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " Jul 13 03:37:33.327409 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.327280 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-home\") pod \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\" (UID: \"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1\") " Jul 13 03:37:33.327520 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.327275 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4676ec8d-4f05-47e5-8c47-cee09b0cf2f1" (UID: "4676ec8d-4f05-47e5-8c47-cee09b0cf2f1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:37:33.327520 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.327385 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-model-cache" (OuterVolumeSpecName: "model-cache") pod "4676ec8d-4f05-47e5-8c47-cee09b0cf2f1" (UID: "4676ec8d-4f05-47e5-8c47-cee09b0cf2f1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:37:33.327520 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.327488 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-home" (OuterVolumeSpecName: "home") pod "4676ec8d-4f05-47e5-8c47-cee09b0cf2f1" (UID: "4676ec8d-4f05-47e5-8c47-cee09b0cf2f1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:37:33.327673 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.327658 2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-home\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:37:33.327892 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.327674 2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-tmp-dir\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:37:33.327892 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.327685 2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-model-cache\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:37:33.329750 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.329714 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4676ec8d-4f05-47e5-8c47-cee09b0cf2f1" (UID: "4676ec8d-4f05-47e5-8c47-cee09b0cf2f1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 03:37:33.329863 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.329759 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-dshm" (OuterVolumeSpecName: "dshm") pod "4676ec8d-4f05-47e5-8c47-cee09b0cf2f1" (UID: "4676ec8d-4f05-47e5-8c47-cee09b0cf2f1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 03:37:33.329863 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.329761 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-kube-api-access-chgqk" (OuterVolumeSpecName: "kube-api-access-chgqk") pod "4676ec8d-4f05-47e5-8c47-cee09b0cf2f1" (UID: "4676ec8d-4f05-47e5-8c47-cee09b0cf2f1"). InnerVolumeSpecName "kube-api-access-chgqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 03:37:33.428769 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.428723 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chgqk\" (UniqueName: \"kubernetes.io/projected/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-kube-api-access-chgqk\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:37:33.428769 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.428760 2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-tls-certs\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:37:33.428769 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:33.428769 2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1-dshm\") on node \"ip-10-0-130-225.ec2.internal\" DevicePath \"\"" Jul 13 03:37:34.056413 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:34.056371 2563 generic.go:356] "Generic (PLEG): container finished" podID="4676ec8d-4f05-47e5-8c47-cee09b0cf2f1" containerID="2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb" exitCode=0 Jul 13 03:37:34.056862 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:34.056419 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" Jul 13 03:37:34.056862 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:34.056456 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" event={"ID":"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1","Type":"ContainerDied","Data":"2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb"} Jul 13 03:37:34.056862 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:34.056507 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l" event={"ID":"4676ec8d-4f05-47e5-8c47-cee09b0cf2f1","Type":"ContainerDied","Data":"1c4a1b7e458492f00cf0dc6e8d91622ac29c23c81cccd5cdb4c939b72442cc4f"} Jul 13 03:37:34.056862 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:34.056526 2563 scope.go:117] "RemoveContainer" containerID="2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb" Jul 13 03:37:34.067135 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:34.067112 2563 scope.go:117] "RemoveContainer" containerID="2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb" Jul 13 03:37:34.067646 ip-10-0-130-225 kubenswrapper[2563]: E0713 03:37:34.067624 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb\": container with ID starting with 2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb not found: ID does not exist" containerID="2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb" Jul 13 03:37:34.067732 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:34.067655 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb"} err="failed to get container status \"2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb\": rpc error: code = NotFound desc = could not find container \"2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb\": container with ID starting with 2ec49cc79b6094271235a64b1f8c68968b353c7fbacfc03f0d1f05cd940695bb not found: ID does not exist" Jul 13 03:37:34.071851 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:34.071822 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l"] Jul 13 03:37:34.075255 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:34.075229 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-766a483d/e2e-lifecycle-model-766a483d-kserve-546d78b979-x2j7l"] Jul 13 03:37:35.468872 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:37:35.468837 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4676ec8d-4f05-47e5-8c47-cee09b0cf2f1" path="/var/lib/kubelet/pods/4676ec8d-4f05-47e5-8c47-cee09b0cf2f1/volumes" Jul 13 03:41:59.589196 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:41:59.589087 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:41:59.602795 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:41:59.602757 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:42:27.926028 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:27.925991 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b6d4464cd-wg9bm_b94f2a38-d5fd-4e14-8863-d37fb0fd9d69/authorino/0.log" Jul 13 03:42:33.191421 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:33.191391 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp_7889f8e7-2f27-434a-993a-6fec8c4cbba3/copy-manifests/0.log" Jul 13 03:42:33.199774 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:33.199753 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp_7889f8e7-2f27-434a-993a-6fec8c4cbba3/manager/0.log" Jul 13 03:42:35.157180 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:35.157112 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b6d4464cd-wg9bm_b94f2a38-d5fd-4e14-8863-d37fb0fd9d69/authorino/0.log" Jul 13 03:42:35.261260 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:35.261228 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lrpsd_d3798ce2-92a7-4641-8215-380236ee81ad/manager/0.log" Jul 13 03:42:36.636655 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:36.636623 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d889b4b4f-kngvr_ffce1075-7023-49f4-b091-7081254b2bfa/kube-auth-proxy/0.log" Jul 13 03:42:37.552651 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:37.552620 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bjvwz_2ff6fb54-84c7-489d-9f3f-0d9814ebcbfd/main/0.log" Jul 13 03:42:37.772600 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:37.772559 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db5g8cd_5b123f0b-86c6-44a5-94b1-519a0c342f36/main/0.log" Jul 13 03:42:37.989718 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:37.989688 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-vd5r2_33d62490-f7af-4bef-a8b6-06e9011b13f2/main/0.log" Jul 13 03:42:44.664505 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:44.664473 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mjztv_061e47b1-79f8-4431-8569-de9d25e36495/global-pull-secret-syncer/0.log" Jul 13 03:42:44.738329 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:44.738299 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-n5xv8_aa509e31-3c30-48b7-9f01-7f09f51229c6/konnectivity-agent/0.log" Jul 13 03:42:44.797205 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:44.797177 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-225.ec2.internal_71a205fe70f937e6cd223dd5a6fc736b/haproxy/0.log" Jul 13 03:42:49.796419 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:49.796382 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b6d4464cd-wg9bm_b94f2a38-d5fd-4e14-8863-d37fb0fd9d69/authorino/0.log" Jul 13 03:42:49.826385 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:49.826304 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lrpsd_d3798ce2-92a7-4641-8215-380236ee81ad/manager/0.log" Jul 13 03:42:52.024413 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.024374 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-qskgx_f4ae5e21-c8cb-4785-9cce-fd191d73cea9/cluster-monitoring-operator/0.log" Jul 13 03:42:52.048040 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.048007 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-zrldr_52bb6f07-705e-465a-acc6-d895b7861061/kube-state-metrics/0.log" Jul 13 03:42:52.065124 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.065100 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-zrldr_52bb6f07-705e-465a-acc6-d895b7861061/kube-rbac-proxy-main/0.log" Jul 13 03:42:52.089272 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.089246 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-zrldr_52bb6f07-705e-465a-acc6-d895b7861061/kube-rbac-proxy-self/0.log" Jul 13 03:42:52.116055 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.116024 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d4fc5ddcd-zdxcc_53b28800-64f1-4dbc-be29-e17dd977486c/metrics-server/0.log" Jul 13 03:42:52.166822 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.166789 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-jz7fn_b45801aa-64bb-4ec6-874f-581074d11270/monitoring-plugin/0.log" Jul 13 03:42:52.193235 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.193213 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fn64x_759233fd-a5b1-4e6d-b77b-859706b26082/node-exporter/0.log" Jul 13 03:42:52.211582 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.211564 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fn64x_759233fd-a5b1-4e6d-b77b-859706b26082/kube-rbac-proxy/0.log" Jul 13 03:42:52.232979 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.232958 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fn64x_759233fd-a5b1-4e6d-b77b-859706b26082/init-textfile/0.log" Jul 13 03:42:52.405452 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.405421 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-5vkgd_961715f0-251e-4dfb-aea4-ef01963c6e7f/kube-rbac-proxy-main/0.log" Jul 13 03:42:52.426383 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.426355 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-5vkgd_961715f0-251e-4dfb-aea4-ef01963c6e7f/kube-rbac-proxy-self/0.log" Jul 13 03:42:52.445567 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.445499 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-5vkgd_961715f0-251e-4dfb-aea4-ef01963c6e7f/openshift-state-metrics/0.log" Jul 13 03:42:52.496714 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.496687 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0/prometheus/0.log" Jul 13 03:42:52.521599 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.521573 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0/config-reloader/0.log" Jul 13 03:42:52.543600 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.543576 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0/thanos-sidecar/0.log" Jul 13 03:42:52.561473 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.561451 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0/kube-rbac-proxy-web/0.log" Jul 13 03:42:52.583735 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.583718 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0/kube-rbac-proxy/0.log" Jul 13 03:42:52.603288 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.603266 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0/kube-rbac-proxy-thanos/0.log" Jul 13 03:42:52.623337 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.623315 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b48a7d8f-a4d6-4260-b71f-a337ea1bd1d0/init-config-reloader/0.log" Jul 13 03:42:52.690379 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:52.690353 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-zcm67_10fa53a3-7506-4b99-8786-4c6bafb06ad8/prometheus-operator-admission-webhook/0.log" Jul 13 03:42:54.357803 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.357768 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6"] Jul 13 03:42:54.358230 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.358155 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4676ec8d-4f05-47e5-8c47-cee09b0cf2f1" containerName="main" Jul 13 03:42:54.358230 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.358169 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4676ec8d-4f05-47e5-8c47-cee09b0cf2f1" containerName="main" Jul 13 03:42:54.358354 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.358264 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4676ec8d-4f05-47e5-8c47-cee09b0cf2f1" containerName="main" Jul 13 03:42:54.361589 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.361569 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.363853 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.363834 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xjlbl\"/\"openshift-service-ca.crt\"" Jul 13 03:42:54.363957 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.363838 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xjlbl\"/\"default-dockercfg-5wgrz\"" Jul 13 03:42:54.364986 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.364968 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xjlbl\"/\"kube-root-ca.crt\"" Jul 13 03:42:54.370384 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.370364 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6"] Jul 13 03:42:54.496052 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.496016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1946652f-e773-48dd-a23e-101fb497b715-proc\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.496052 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.496054 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gznvr\" (UniqueName: \"kubernetes.io/projected/1946652f-e773-48dd-a23e-101fb497b715-kube-api-access-gznvr\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.496281 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.496094 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1946652f-e773-48dd-a23e-101fb497b715-podres\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.496281 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.496118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1946652f-e773-48dd-a23e-101fb497b715-sys\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.496281 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.496225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1946652f-e773-48dd-a23e-101fb497b715-lib-modules\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.581777 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.581743 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/1.log" Jul 13 03:42:54.585904 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.585884 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-5qxrj_652d8372-f1b2-440e-9282-d1226a028bf9/console-operator/2.log" Jul 13 03:42:54.597489 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.597467 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1946652f-e773-48dd-a23e-101fb497b715-lib-modules\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.597643 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.597498 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1946652f-e773-48dd-a23e-101fb497b715-proc\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.597643 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.597517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gznvr\" (UniqueName: \"kubernetes.io/projected/1946652f-e773-48dd-a23e-101fb497b715-kube-api-access-gznvr\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.597643 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.597551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1946652f-e773-48dd-a23e-101fb497b715-podres\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.597643 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.597577 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1946652f-e773-48dd-a23e-101fb497b715-sys\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.597643 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.597614 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1946652f-e773-48dd-a23e-101fb497b715-proc\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.597643 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.597634 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1946652f-e773-48dd-a23e-101fb497b715-lib-modules\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.597880 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.597654 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1946652f-e773-48dd-a23e-101fb497b715-sys\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.597880 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.597727 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1946652f-e773-48dd-a23e-101fb497b715-podres\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.604957 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.604931 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gznvr\" (UniqueName: \"kubernetes.io/projected/1946652f-e773-48dd-a23e-101fb497b715-kube-api-access-gznvr\") pod \"perf-node-gather-daemonset-x9jz6\" (UID: \"1946652f-e773-48dd-a23e-101fb497b715\") " pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.672487 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.672407 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:54.807821 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:54.807796 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6"] Jul 13 03:42:54.810236 ip-10-0-130-225 kubenswrapper[2563]: W0713 03:42:54.810211 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1946652f_e773_48dd_a23e_101fb497b715.slice/crio-6c28644798c585817d0104943b10a1b33cdad7b8d06fc57c55456fd8691d7407 WatchSource:0}: Error finding container 6c28644798c585817d0104943b10a1b33cdad7b8d06fc57c55456fd8691d7407: Status 404 returned error can't find the container with id 6c28644798c585817d0104943b10a1b33cdad7b8d06fc57c55456fd8691d7407 Jul 13 03:42:55.139164 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:55.139115 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-2w2qq_c6907df4-7a1d-4a0b-8d71-df1fa6b70e91/download-server/0.log" Jul 13 03:42:55.609513 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:55.609478 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" event={"ID":"1946652f-e773-48dd-a23e-101fb497b715","Type":"ContainerStarted","Data":"13f1e58f3d9c8edb4391a417c7a0a1a19e9833272b2580e69323abefd364d7ee"} Jul 13 03:42:55.609991 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:55.609537 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" event={"ID":"1946652f-e773-48dd-a23e-101fb497b715","Type":"ContainerStarted","Data":"6c28644798c585817d0104943b10a1b33cdad7b8d06fc57c55456fd8691d7407"} Jul 13 03:42:55.609991 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:55.609598 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:42:55.624271 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:55.624221 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" podStartSLOduration=1.624207789 podStartE2EDuration="1.624207789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:55.622881564 +0000 UTC m=+2756.673688522" watchObservedRunningTime="2026-07-13 03:42:55.624207789 +0000 UTC m=+2756.675014745" Jul 13 03:42:56.679189 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:56.679160 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fshqz_b30fb41b-3f0b-4428-a776-d07b8c2d071f/dns/0.log" Jul 13 03:42:56.700485 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:56.700461 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fshqz_b30fb41b-3f0b-4428-a776-d07b8c2d071f/kube-rbac-proxy/0.log" Jul 13 03:42:56.761316 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:56.761287 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8cqcw_7359c1d2-d166-472c-b46e-c1ed274b850f/dns-node-resolver/0.log" Jul 13 03:42:57.292279 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:57.292253 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-859795f5db-lrfbd_34f4c7ae-77d4-4b08-84d0-8530bfa10f1b/registry/0.log" Jul 13 03:42:57.331813 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:57.331773 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pqxkj_d9d75b76-1bcc-4a00-b3dc-dc71dbf7616d/node-ca/0.log" Jul 13 03:42:58.346667 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:58.346637 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d889b4b4f-kngvr_ffce1075-7023-49f4-b091-7081254b2bfa/kube-auth-proxy/0.log" Jul 13 03:42:59.143879 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:59.143847 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7rlxp_bbba74a8-4ac0-48db-8236-d8951b76f810/serve-healthcheck-canary/0.log" Jul 13 03:42:59.602459 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:59.602425 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-ggnr5_4a176d83-a5e9-45cf-b5f5-f64d25f4e878/insights-operator/0.log" Jul 13 03:42:59.602808 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:59.602664 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-ggnr5_4a176d83-a5e9-45cf-b5f5-f64d25f4e878/insights-operator/1.log" Jul 13 03:42:59.679130 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:59.679098 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-njnf7_40eba173-65f6-4b4a-a198-d6781b5e12f6/kube-rbac-proxy/0.log" Jul 13 03:42:59.696817 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:59.696794 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-njnf7_40eba173-65f6-4b4a-a198-d6781b5e12f6/exporter/0.log" Jul 13 03:42:59.714547 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:42:59.714522 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-njnf7_40eba173-65f6-4b4a-a198-d6781b5e12f6/extractor/0.log" Jul 13 03:43:01.624223 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:01.624199 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xjlbl/perf-node-gather-daemonset-x9jz6" Jul 13 03:43:02.039808 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:02.039783 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp_7889f8e7-2f27-434a-993a-6fec8c4cbba3/manager/0.log" Jul 13 03:43:02.058222 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:02.058197 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dcb9ff95f-5pkqp_7889f8e7-2f27-434a-993a-6fec8c4cbba3/copy-manifests/0.log" Jul 13 03:43:03.411617 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:03.411589 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f4bfdbc5d-vhw6t_aa55733c-521e-4688-99d1-9cbd6bd01e4f/manager/0.log" Jul 13 03:43:05.014903 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:05.014880 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d889b4b4f-kngvr_ffce1075-7023-49f4-b091-7081254b2bfa/kube-auth-proxy/0.log" Jul 13 03:43:06.348967 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:06.348939 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d889b4b4f-kngvr_ffce1075-7023-49f4-b091-7081254b2bfa/kube-auth-proxy/0.log" Jul 13 03:43:08.533189 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:08.533152 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2lf2m_d29cc68e-2daa-454d-8ed9-c91d0d2c20f1/migrator/0.log" Jul 13 03:43:08.551748 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:08.551710 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-2lf2m_d29cc68e-2daa-454d-8ed9-c91d0d2c20f1/graceful-termination/0.log" Jul 13 03:43:08.880972 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:08.880888 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-4b9bp_3cc96dbc-0428-466b-abf1-b79890000d7b/kube-storage-version-migrator-operator/1.log" Jul 13 03:43:08.881707 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:08.881688 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-4b9bp_3cc96dbc-0428-466b-abf1-b79890000d7b/kube-storage-version-migrator-operator/0.log" Jul 13 03:43:09.855289 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:09.855256 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n6mg_f75dab3f-51d7-44b4-98fc-b85d6dda202d/kube-multus-additional-cni-plugins/0.log" Jul 13 03:43:09.873410 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:09.873379 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n6mg_f75dab3f-51d7-44b4-98fc-b85d6dda202d/egress-router-binary-copy/0.log" Jul 13 03:43:09.891654 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:09.891624 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n6mg_f75dab3f-51d7-44b4-98fc-b85d6dda202d/cni-plugins/0.log" Jul 13 03:43:09.910733 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:09.910700 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n6mg_f75dab3f-51d7-44b4-98fc-b85d6dda202d/bond-cni-plugin/0.log" Jul 13 03:43:09.928715 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:09.928683 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n6mg_f75dab3f-51d7-44b4-98fc-b85d6dda202d/routeoverride-cni/0.log" Jul 13 03:43:09.946630 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:09.946604 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n6mg_f75dab3f-51d7-44b4-98fc-b85d6dda202d/whereabouts-cni-bincopy/0.log" Jul 13 03:43:09.967620 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:09.967593 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2n6mg_f75dab3f-51d7-44b4-98fc-b85d6dda202d/whereabouts-cni/0.log" Jul 13 03:43:10.304641 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:10.304614 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jv6rr_cc339015-ab80-470e-b028-fbfe7dfe72de/kube-multus/0.log" Jul 13 03:43:10.383087 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:10.383056 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nk7sp_03bd910c-0e0d-4afd-882a-9510de44edfd/network-metrics-daemon/0.log" Jul 13 03:43:10.400462 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:10.400431 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nk7sp_03bd910c-0e0d-4afd-882a-9510de44edfd/kube-rbac-proxy/0.log" Jul 13 03:43:11.415668 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:11.415634 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2jhl_e53a37ee-b063-4f68-9740-4cb2d845ee58/ovn-controller/0.log" Jul 13 03:43:11.432927 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:11.432899 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2jhl_e53a37ee-b063-4f68-9740-4cb2d845ee58/ovn-acl-logging/0.log" Jul 13 03:43:11.456081 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:11.456042 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2jhl_e53a37ee-b063-4f68-9740-4cb2d845ee58/kube-rbac-proxy-node/0.log" Jul 13 03:43:11.474578 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:11.474551 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2jhl_e53a37ee-b063-4f68-9740-4cb2d845ee58/kube-rbac-proxy-ovn-metrics/0.log" Jul 13 03:43:11.491549 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:11.491517 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2jhl_e53a37ee-b063-4f68-9740-4cb2d845ee58/northd/0.log" Jul 13 03:43:11.509397 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:11.509372 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2jhl_e53a37ee-b063-4f68-9740-4cb2d845ee58/nbdb/0.log" Jul 13 03:43:11.527293 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:11.527268 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2jhl_e53a37ee-b063-4f68-9740-4cb2d845ee58/sbdb/0.log" Jul 13 03:43:11.568968 ip-10-0-130-225 kubenswrapper[2563]: I0713 03:43:11.568935 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p2jhl_e53a37ee-b063-4f68-9740-4cb2d845ee58/ovnkube-controller/0.log"