Jul 03 19:10:19.732053 ip-10-0-130-57 systemd[1]: Starting Kubernetes Kubelet... Jul 03 19:10:20.214397 ip-10-0-130-57 systemd[1]: Started Kubernetes Kubelet. Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.140381 2587 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.144947 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.144968 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.144972 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.144976 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.144980 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.144983 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.144986 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:10:20.230882 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.144989 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.144992 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.144995 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.144998 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145000 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145003 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145005 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145008 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145011 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145013 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145016 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145019 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145021 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145024 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145026 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145030 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145035 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145038 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145041 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:10:20.238712 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145045 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145047 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145050 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145053 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145056 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145059 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145062 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145066 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145069 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145072 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145075 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145077 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145081 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145084 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145086 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145089 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145092 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145094 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145097 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:10:20.239373 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145099 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145102 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145104 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145107 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145109 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145112 2587 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145114 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145117 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145119 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145122 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145126 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145128 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145131 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145134 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145136 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145140 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145142 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145145 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145148 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145150 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:10:20.240817 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145153 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145156 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145160 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145162 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145165 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145167 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145170 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145172 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145175 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145177 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145181 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145184 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145186 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145189 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145192 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145195 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145198 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145201 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145203 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145206 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:10:20.241610 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145208 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145211 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145215 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145219 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145222 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145225 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145228 2587 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145231 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145234 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145237 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145240 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145242 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145245 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.145248 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146010 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146017 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146020 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146023 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146027 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146031 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:10:20.242816 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146034 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146036 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146039 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146042 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146044 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146047 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146050 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146052 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146055 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146058 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146060 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146062 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146065 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146067 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146070 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146073 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146076 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146080 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146083 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:10:20.248689 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146086 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146089 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146091 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146111 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146115 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146118 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146121 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146124 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146127 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146130 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146133 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146136 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146139 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146142 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146145 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146147 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146150 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146152 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146155 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146157 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:10:20.249386 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146160 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146162 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146165 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146168 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146171 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146174 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146178 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146183 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146185 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146188 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146191 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146193 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146196 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146198 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146201 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146204 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146206 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146209 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146211 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:10:20.250109 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146213 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146216 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146218 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146221 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146225 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146228 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146230 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146233 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146235 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146238 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146240 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146243 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146245 2587 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146249 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146252 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146254 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146257 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146261 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146263 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146266 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:10:20.251906 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146269 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146272 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146276 2587 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146279 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146281 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146284 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146287 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146289 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146292 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146294 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146297 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146299 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146302 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146304 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.146307 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149145 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149158 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149162 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149166 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149171 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:10:20.252614 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149175 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149183 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149186 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149189 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149194 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149197 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149200 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149203 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149208 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149211 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149213 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149218 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149222 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149232 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149236 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149238 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149243 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149246 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149248 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149251 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:10:20.253316 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149256 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149259 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149262 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149267 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149270 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149273 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149280 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149283 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149286 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149289 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149292 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149296 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149300 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149306 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149309 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149312 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149317 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149320 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149327 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:10:20.346418 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149330 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149333 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149335 2587 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149340 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149343 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149346 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149349 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149353 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149356 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149359 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149361 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149366 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149371 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149378 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149382 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149388 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149391 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149394 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149400 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:10:20.347861 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149405 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149408 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149413 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149416 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149419 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149427 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149429 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149433 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149438 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149441 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149444 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149446 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149451 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149453 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149456 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149459 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149468 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149470 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149475 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149478 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:10:20.349852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149480 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149483 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149488 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149491 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149494 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149498 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149501 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149504 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149509 2587 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149512 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149514 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149517 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149520 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149528 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149531 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.149536 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149649 2587 flags.go:64] FLAG: --address="0.0.0.0" Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149659 2587 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149670 2587 flags.go:64] FLAG: --anonymous-auth="true" Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149683 2587 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149687 2587 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 03 19:10:20.350640 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149690 2587 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149710 2587 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149716 2587 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149720 2587 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149723 2587 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149727 2587 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149730 2587 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149734 2587 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149737 2587 flags.go:64] FLAG: --cgroup-root="" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149746 2587 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149749 2587 flags.go:64] FLAG: --client-ca-file="" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149755 2587 flags.go:64] FLAG: --cloud-provider="external" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149758 2587 flags.go:64] FLAG: --cluster-dns="[]" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149763 2587 flags.go:64] FLAG: --cluster-domain="" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149784 2587 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149787 2587 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149793 2587 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149797 2587 flags.go:64] FLAG: --container-log-max-files="5" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149805 2587 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149809 2587 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149812 2587 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149817 2587 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149821 2587 flags.go:64] FLAG: --contention-profiling="false" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149824 2587 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 03 19:10:20.352597 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149833 2587 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149836 2587 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149844 2587 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149849 2587 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149859 2587 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149862 2587 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149868 2587 flags.go:64] FLAG: --enable-load-reader="false" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149871 2587 flags.go:64] FLAG: --enable-server="true" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149874 2587 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149882 2587 flags.go:64] FLAG: --event-burst="100" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149888 2587 flags.go:64] FLAG: --event-qps="50" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149893 2587 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149896 2587 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149899 2587 flags.go:64] FLAG: --eviction-hard="" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149906 2587 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149909 2587 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149912 2587 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149917 2587 flags.go:64] FLAG: --eviction-soft="" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149920 2587 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149928 2587 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149931 2587 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149934 2587 flags.go:64] FLAG: --experimental-mounter-path="" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149939 2587 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149942 2587 flags.go:64] FLAG: --fail-swap-on="true" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149945 2587 flags.go:64] FLAG: --feature-gates="" Jul 03 19:10:20.353753 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149948 2587 flags.go:64] FLAG: --file-check-frequency="20s" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149951 2587 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149959 2587 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149966 2587 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149969 2587 flags.go:64] FLAG: --healthz-port="10248" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149972 2587 flags.go:64] FLAG: --help="false" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149978 2587 flags.go:64] FLAG: --hostname-override="ip-10-0-130-57.ec2.internal" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149983 2587 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149988 2587 flags.go:64] FLAG: --http-check-frequency="20s" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149991 2587 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.149995 2587 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150003 2587 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150006 2587 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150009 2587 flags.go:64] FLAG: --image-service-endpoint="" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150015 2587 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150018 2587 flags.go:64] FLAG: --kube-api-burst="100" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150021 2587 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150026 2587 flags.go:64] FLAG: --kube-api-qps="50" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150029 2587 flags.go:64] FLAG: --kube-reserved="" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150037 2587 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150040 2587 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150043 2587 flags.go:64] FLAG: --kubelet-cgroups="" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150046 2587 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150051 2587 flags.go:64] FLAG: --lock-file="" Jul 03 19:10:20.354917 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150054 2587 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150057 2587 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150062 2587 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150067 2587 flags.go:64] FLAG: --log-json-split-stream="false" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150075 2587 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150078 2587 flags.go:64] FLAG: --log-text-split-stream="false" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150081 2587 flags.go:64] FLAG: --logging-format="text" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150086 2587 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150089 2587 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150092 2587 flags.go:64] FLAG: --manifest-url="" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150099 2587 flags.go:64] FLAG: --manifest-url-header="" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150104 2587 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150112 2587 flags.go:64] FLAG: --max-open-files="1000000" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150116 2587 flags.go:64] FLAG: --max-pods="110" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150119 2587 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150126 2587 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150129 2587 flags.go:64] FLAG: --memory-manager-policy="None" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150134 2587 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150137 2587 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150140 2587 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150148 2587 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150158 2587 flags.go:64] FLAG: --node-status-max-images="50" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150162 2587 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150169 2587 flags.go:64] FLAG: --oom-score-adj="-999" Jul 03 19:10:20.356079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150172 2587 flags.go:64] FLAG: --pod-cidr="" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150175 2587 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150185 2587 flags.go:64] FLAG: --pod-manifest-path="" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150194 2587 flags.go:64] FLAG: --pod-max-pids="-1" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150197 2587 flags.go:64] FLAG: --pods-per-core="0" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150200 2587 flags.go:64] FLAG: --port="10250" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150206 2587 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150209 2587 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09eb8551c80023b53" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150212 2587 flags.go:64] FLAG: --qos-reserved="" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150217 2587 flags.go:64] FLAG: --read-only-port="10255" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150220 2587 flags.go:64] FLAG: --register-node="true" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150223 2587 flags.go:64] FLAG: --register-with-taints="" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150231 2587 flags.go:64] FLAG: --registry-burst="10" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150234 2587 flags.go:64] FLAG: --registry-qps="5" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150237 2587 flags.go:64] FLAG: --reserved-cpus="" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150242 2587 flags.go:64] FLAG: --reserved-memory="" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150246 2587 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150250 2587 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150257 2587 flags.go:64] FLAG: --rotate-certificates="false" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150259 2587 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150267 2587 flags.go:64] FLAG: --runonce="false" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150270 2587 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150273 2587 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150279 2587 flags.go:64] FLAG: --seccomp-default="false" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150283 2587 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 03 19:10:20.357202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150286 2587 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150292 2587 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150295 2587 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150298 2587 flags.go:64] FLAG: --storage-driver-password="root" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150305 2587 flags.go:64] FLAG: --storage-driver-secure="false" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150309 2587 flags.go:64] FLAG: --storage-driver-table="stats" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150314 2587 flags.go:64] FLAG: --storage-driver-user="root" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150317 2587 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150320 2587 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150329 2587 flags.go:64] FLAG: --system-cgroups="" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150333 2587 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150344 2587 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150349 2587 flags.go:64] FLAG: --tls-cert-file="" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150352 2587 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150357 2587 flags.go:64] FLAG: --tls-min-version="" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150362 2587 flags.go:64] FLAG: --tls-private-key-file="" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150365 2587 flags.go:64] FLAG: --topology-manager-policy="none" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150367 2587 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150372 2587 flags.go:64] FLAG: --topology-manager-scope="container" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150378 2587 flags.go:64] FLAG: --v="2" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150381 2587 flags.go:64] FLAG: --version="false" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150386 2587 flags.go:64] FLAG: --vmodule="" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150389 2587 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.150396 2587 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150656 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:10:20.358315 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150665 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150671 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150674 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150678 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150682 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150686 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150695 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150698 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150701 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150705 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150708 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150711 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150714 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150719 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150722 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150725 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150730 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150732 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150735 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150742 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:10:20.359463 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150745 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150747 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150752 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150755 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150758 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150763 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150765 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150768 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150796 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150799 2587 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150802 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150808 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150812 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150816 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150819 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150822 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150824 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150829 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150833 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150836 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:10:20.360226 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150841 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150844 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150846 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150854 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150856 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150859 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150865 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150867 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150871 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150877 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150880 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150882 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150889 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150892 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150897 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150903 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150906 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150911 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150914 2587 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150917 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:10:20.361027 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150922 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150925 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150927 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150933 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150937 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150945 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150948 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150951 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150958 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150961 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150967 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150970 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150972 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150975 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150979 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150982 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150985 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150989 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150992 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.150995 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:10:20.361788 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151000 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151004 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151007 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151010 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151013 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151015 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151018 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151023 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151027 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151030 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151035 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151038 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151040 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151048 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151051 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151056 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151063 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:10:20.362560 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.151068 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.151074 2587 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.158176 2587 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.158197 2587 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.158215 2587 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.158224 2587 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158276 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158281 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158285 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158290 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158294 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158297 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158300 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158302 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:10:20.363319 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158305 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158308 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158311 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158314 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158316 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158319 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158324 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158326 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158329 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158332 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158334 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158337 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158340 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158342 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158347 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158349 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158352 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158356 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158358 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158361 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:10:20.365255 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158364 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158366 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158369 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158371 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158374 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158376 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158378 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158381 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158384 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158386 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158389 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158391 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158394 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158396 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158399 2587 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158403 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158405 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158408 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158414 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158417 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:10:20.366013 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158419 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158422 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158425 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158428 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158430 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158433 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158438 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158440 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158443 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158446 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158449 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158451 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158454 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158456 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158459 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158461 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158464 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158466 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158469 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158471 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:10:20.368329 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158473 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158476 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158479 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158481 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158484 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158486 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158489 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158491 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158494 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158496 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158500 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158503 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158505 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158508 2587 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158510 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158514 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158518 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158521 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158526 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158528 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:10:20.369078 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158531 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158533 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158537 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158541 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158544 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158547 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158550 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158552 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158555 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158558 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158561 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.158566 2587 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158675 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158680 2587 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 19:10:20.370631 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158683 2587 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158686 2587 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158688 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158691 2587 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158694 2587 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158696 2587 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158699 2587 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158701 2587 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158705 2587 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158708 2587 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158710 2587 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158713 2587 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158715 2587 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158718 2587 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158720 2587 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158724 2587 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158728 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158732 2587 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158735 2587 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 19:10:20.371401 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158738 2587 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158741 2587 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158743 2587 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158746 2587 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158749 2587 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158751 2587 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158754 2587 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158756 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158759 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158761 2587 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158764 2587 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158766 2587 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158782 2587 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158785 2587 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158788 2587 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158790 2587 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158793 2587 feature_gate.go:328] unrecognized feature gate: Example Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158797 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158799 2587 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158802 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 19:10:20.372119 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158805 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158808 2587 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158811 2587 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158813 2587 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158816 2587 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158818 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158821 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158823 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158826 2587 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158829 2587 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158834 2587 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158836 2587 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158839 2587 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158842 2587 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158844 2587 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158847 2587 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158850 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158853 2587 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158856 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158858 2587 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 19:10:20.372895 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158861 2587 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158863 2587 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158866 2587 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158868 2587 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158871 2587 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158873 2587 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158876 2587 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158878 2587 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158881 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158883 2587 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158886 2587 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158888 2587 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158891 2587 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158896 2587 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158899 2587 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158902 2587 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158905 2587 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158908 2587 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158911 2587 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 19:10:20.373660 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158914 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158917 2587 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158919 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158923 2587 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158926 2587 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158928 2587 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158931 2587 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158934 2587 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158936 2587 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158939 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158943 2587 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158945 2587 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158948 2587 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158951 2587 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158953 2587 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158956 2587 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158958 2587 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158961 2587 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 19:10:20.470492 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:20.158963 2587 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 19:10:20.471265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.158968 2587 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 19:10:20.471265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.159075 2587 server.go:962] "Client rotation is on, will bootstrap in background" Jul 03 19:10:20.471265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.161900 2587 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 03 19:10:20.471265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.163336 2587 server.go:1019] "Starting client certificate rotation" Jul 03 19:10:20.471265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.163432 2587 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 19:10:20.471265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.163461 2587 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 19:10:20.471265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.166019 2587 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 19:10:20.471265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.167192 2587 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 19:10:20.471265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.178245 2587 log.go:25] "Validated CRI v1 runtime API" Jul 03 19:10:20.471265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.181951 2587 log.go:25] "Validated CRI v1 image API" Jul 03 19:10:20.471265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.183676 2587 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 03 19:10:20.471265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.186700 2587 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7c0da45e-ad66-4a92-922d-d54fd88e4a45:/dev/nvme0n1p3 c366a5fe-a113-491e-a3f9-dfbc06485e57:/dev/nvme0n1p4] Jul 03 19:10:20.472082 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.186716 2587 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 03 19:10:20.472453 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.193096 2587 manager.go:216] Machine: {Timestamp:2026-07-03 19:10:20.191699958 +0000 UTC m=+0.339352226 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3122646 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e0130029a52bda355a729917677a0 SystemUUID:ec2e0130-029a-52bd-a355-a729917677a0 BootID:3f9090d8-f959-4440-a747-0fcc4ede4d22 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7f:b1:9e:7c:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7f:b1:9e:7c:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:37:25:e9:75:6a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 03 19:10:20.472453 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.193222 2587 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 03 19:10:20.472453 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.193316 2587 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 03 19:10:20.472453 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.195142 2587 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 19:10:20.472453 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.196510 2587 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 03 19:10:20.472453 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.196539 2587 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 03 19:10:20.472453 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.197887 2587 topology_manager.go:138] "Creating topology manager with none policy" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.197902 2587 container_manager_linux.go:309] "Creating device plugin manager" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.197911 2587 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.198549 2587 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.199973 2587 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.202993 2587 state_mem.go:36] "Initialized new in-memory state store" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.203128 2587 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.203160 2587 kubelet.go:486] "Attempting to sync node with API server" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.203172 2587 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.203182 2587 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.203197 2587 kubelet.go:398] "Adding apiserver pod source" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.203206 2587 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.203564 2587 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.203580 2587 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.205681 2587 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.207845 2587 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.207882 2587 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209010 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209027 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209037 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209045 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209056 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209065 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209076 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209086 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209095 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209104 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209115 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209123 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209855 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.209866 2587 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.213501 2587 server.go:1268] "Started kubelet" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.213575 2587 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.213568 2587 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.213646 2587 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.214415 2587 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.214514 2587 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.214874 2587 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.214875 2587 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.215980 2587 server.go:310] "Adding debug handlers to kubelet server" Jul 03 19:10:20.473635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.219089 2587 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7rpf7" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.219963 2587 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.220587 2587 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.220614 2587 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.220675 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.221174 2587 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.221176 2587 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.221261 2587 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.221394 2587 reconstruct.go:97] "Volume reconstruction finished" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.221404 2587 reconciler.go:29] "Reconciler: start to sync state" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.221393 2587 factory.go:55] Registering systemd factory Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.221421 2587 factory.go:223] Registration of the systemd container factory successfully Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.221662 2587 factory.go:153] Registering CRI-O factory Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.221675 2587 factory.go:223] Registration of the crio container factory successfully Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.221724 2587 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.221750 2587 factory.go:103] Registering Raw factory Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.221763 2587 manager.go:1196] Started watching for new ooms in manager Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.221020 2587 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-57.ec2.internal.18bedd4bd2c1616b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-57.ec2.internal,UID:ip-10-0-130-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-57.ec2.internal,},FirstTimestamp:2026-07-03 19:10:20.213469547 +0000 UTC m=+0.361121796,LastTimestamp:2026-07-03 19:10:20.213469547 +0000 UTC m=+0.361121796,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-57.ec2.internal,}" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.222141 2587 manager.go:349] Starting recovery of all containers Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.227286 2587 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7rpf7" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.227888 2587 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.227886 2587 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.231047 2587 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.234031 2587 manager.go:354] Recovery completed Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.238393 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.241073 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-57.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.241104 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.241117 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-57.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.241681 2587 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.241690 2587 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.241707 2587 state_mem.go:36] "Initialized new in-memory state store" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.241688 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.242493 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-57.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:10:20.475178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.242517 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:10:20.477140 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.242530 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-57.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:10:20.477140 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.242888 2587 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-57.ec2.internal.18bedd4bd466cf20 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-57.ec2.internal,UID:ip-10-0-130-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-57.ec2.internal,},FirstTimestamp:2026-07-03 19:10:20.241088288 +0000 UTC m=+0.388740540,LastTimestamp:2026-07-03 19:10:20.241088288 +0000 UTC m=+0.388740540,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-57.ec2.internal,}" Jul 03 19:10:20.477140 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.321135 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:20.477140 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.421568 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:20.477140 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.434781 2587 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-57.ec2.internal\" not found" node="ip-10-0-130-57.ec2.internal" Jul 03 19:10:20.587306 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.521999 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:20.703026 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.622506 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:20.820222 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.723560 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:20.820222 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.765313 2587 policy_none.go:49] "None policy: Start" Jul 03 19:10:20.820222 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.765366 2587 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 03 19:10:20.820222 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.765382 2587 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 03 19:10:20.820222 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:20.766647 2587 policy_none.go:47] "Start" Jul 03 19:10:20.826115 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.824394 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:20.940893 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:20.924939 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:21.062047 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:21.025548 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:21.167217 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:21.126135 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:21.167217 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.162454 2587 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 03 19:10:21.227265 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:21.227190 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:21.235549 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.235515 2587 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 19:05:20 +0000 UTC" deadline="2028-04-12 21:57:34.821214636 +0000 UTC" Jul 03 19:10:21.236053 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.235550 2587 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15578h47m13.58566799s" Jul 03 19:10:21.302033 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.301907 2587 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-57.ec2.internal" not found Jul 03 19:10:21.319137 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.319120 2587 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-57.ec2.internal" not found Jul 03 19:10:21.327821 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:21.327798 2587 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:21.333513 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.333500 2587 manager.go:337] "Starting Device Plugin manager" Jul 03 19:10:21.333601 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:21.333532 2587 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 03 19:10:21.333601 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.333542 2587 server.go:87] "Starting device plugin registration server" Jul 03 19:10:21.333807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.333788 2587 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 03 19:10:21.333871 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.333802 2587 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 03 19:10:21.333961 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.333942 2587 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 03 19:10:21.334057 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.334043 2587 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 03 19:10:21.334057 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.334058 2587 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 03 19:10:21.334651 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:21.334624 2587 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 03 19:10:21.334723 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:21.334682 2587 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-57.ec2.internal\" not found" Jul 03 19:10:21.372170 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.372144 2587 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:10:21.377350 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.377334 2587 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-57.ec2.internal" not found Jul 03 19:10:21.434070 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.433913 2587 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 19:10:21.435143 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.435085 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-57.ec2.internal" event="NodeHasSufficientMemory" Jul 03 19:10:21.435143 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.435122 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 19:10:21.435143 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.435136 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-57.ec2.internal" event="NodeHasSufficientPID" Jul 03 19:10:21.435317 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.435170 2587 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.439252 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.439225 2587 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 03 19:10:21.439347 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.439264 2587 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 03 19:10:21.439347 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.439284 2587 kubelet.go:2448] "Starting kubelet main sync loop" Jul 03 19:10:21.439347 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:21.439318 2587 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 03 19:10:21.443241 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.443225 2587 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:10:21.452617 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.452603 2587 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.539883 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.539803 2587 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-57.ec2.internal"] Jul 03 19:10:21.541547 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.541530 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.542595 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.542579 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.568543 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.568518 2587 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.572312 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.572296 2587 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.581080 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.581067 2587 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 19:10:21.585131 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.585115 2587 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 19:10:21.631101 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.631075 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b81e294d243496cfd6a8dce82cfccf39-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal\" (UID: \"b81e294d243496cfd6a8dce82cfccf39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.631224 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.631122 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85fde282788a9bf74b4b07459943d969-config\") pod \"kube-apiserver-proxy-ip-10-0-130-57.ec2.internal\" (UID: \"85fde282788a9bf74b4b07459943d969\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.631224 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.631169 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b81e294d243496cfd6a8dce82cfccf39-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal\" (UID: \"b81e294d243496cfd6a8dce82cfccf39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.631560 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.631547 2587 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:10:21.640669 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.640648 2587 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 19:10:21.732078 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.732053 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b81e294d243496cfd6a8dce82cfccf39-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal\" (UID: \"b81e294d243496cfd6a8dce82cfccf39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.732229 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.732092 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b81e294d243496cfd6a8dce82cfccf39-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal\" (UID: \"b81e294d243496cfd6a8dce82cfccf39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.732229 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.732143 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85fde282788a9bf74b4b07459943d969-config\") pod \"kube-apiserver-proxy-ip-10-0-130-57.ec2.internal\" (UID: \"85fde282788a9bf74b4b07459943d969\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.732229 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.732174 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b81e294d243496cfd6a8dce82cfccf39-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal\" (UID: \"b81e294d243496cfd6a8dce82cfccf39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.732229 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.732195 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b81e294d243496cfd6a8dce82cfccf39-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal\" (UID: \"b81e294d243496cfd6a8dce82cfccf39\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.732229 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.732216 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85fde282788a9bf74b4b07459943d969-config\") pod \"kube-apiserver-proxy-ip-10-0-130-57.ec2.internal\" (UID: \"85fde282788a9bf74b4b07459943d969\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.889130 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.889083 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" Jul 03 19:10:21.889130 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:21.889117 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-57.ec2.internal" Jul 03 19:10:22.204712 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.204624 2587 apiserver.go:52] "Watching apiserver" Jul 03 19:10:22.210584 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.210564 2587 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 03 19:10:22.211929 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.211906 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-9mxvx","openshift-multus/multus-lv8dm","openshift-network-operator/iptables-alerter-phjvd","kube-system/global-pull-secret-syncer-lh4kg","kube-system/kube-apiserver-proxy-ip-10-0-130-57.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal","openshift-multus/network-metrics-daemon-dnsmw","openshift-network-diagnostics/network-check-target-jkr57","openshift-ovn-kubernetes/ovnkube-node-qvdx5","kube-system/konnectivity-agent-cjbmx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp","openshift-cluster-node-tuning-operator/tuned-zcjbt","openshift-dns/node-resolver-snbdp","openshift-image-registry/node-ca-hdp8t"] Jul 03 19:10:22.213442 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.213427 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.214601 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.214577 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.215764 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.215736 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-phjvd" Jul 03 19:10:22.215906 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.215893 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 03 19:10:22.216049 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.216031 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 03 19:10:22.216190 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.216173 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 03 19:10:22.216253 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.216239 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 03 19:10:22.216316 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.216260 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 03 19:10:22.216316 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.216270 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6sbfv\"" Jul 03 19:10:22.216579 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.216558 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 03 19:10:22.216665 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.216645 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hqt62\"" Jul 03 19:10:22.217483 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.217462 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:22.217567 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.217548 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:22.218010 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.217989 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:10:22.218121 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.218107 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 03 19:10:22.218189 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.218128 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 03 19:10:22.218189 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.218140 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xvcx6\"" Jul 03 19:10:22.218589 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.218571 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:22.218678 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.218632 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:22.219670 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.219653 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:22.219756 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.219737 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:22.220930 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.220915 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.221821 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.221804 2587 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 03 19:10:22.222153 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.222137 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cjbmx" Jul 03 19:10:22.223115 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.223092 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 03 19:10:22.223213 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.223148 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 03 19:10:22.223357 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.223235 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 03 19:10:22.223357 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.223235 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 03 19:10:22.223357 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.223298 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4tfbh\"" Jul 03 19:10:22.223808 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.223770 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 03 19:10:22.223950 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.223933 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 03 19:10:22.224114 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.224097 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.225196 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.225023 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 03 19:10:22.225196 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.225101 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g74fj\"" Jul 03 19:10:22.225352 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.225333 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 03 19:10:22.226572 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.226422 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.227290 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.227257 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 03 19:10:22.227439 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.227423 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 03 19:10:22.227529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.227514 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 03 19:10:22.228117 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.228094 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bhgpv\"" Jul 03 19:10:22.228453 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.228433 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-snbdp" Jul 03 19:10:22.229074 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.229052 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:10:22.229074 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.229063 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s8n75\"" Jul 03 19:10:22.229186 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.229069 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 03 19:10:22.229889 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.229869 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hdp8t" Jul 03 19:10:22.230621 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.230602 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 03 19:10:22.230808 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.230793 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8zrnv\"" Jul 03 19:10:22.230879 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.230863 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 03 19:10:22.231952 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.231934 2587 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 19:10:22.232062 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.232009 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 03 19:10:22.232185 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.232170 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c6v78\"" Jul 03 19:10:22.232280 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.232225 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 03 19:10:22.232280 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.232258 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 03 19:10:22.233869 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.233839 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-system-cni-dir\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.233952 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.233875 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-os-release\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.233952 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.233892 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-var-lib-cni-multus\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.233952 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.233911 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57a524e0-ad2c-406e-a6bf-1e2284235fc5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.233952 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.233927 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8d28707-c79a-489a-aef0-b389707b64c1-kubelet-config\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:22.233952 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.233941 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/934e4c19-32e3-4339-a015-0cb04970cd53-cni-binary-copy\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.234110 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.233969 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ecc3701f-7faf-4848-bb1f-09ff724650d0-ovnkube-script-lib\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.234110 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234003 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-multus-cni-dir\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.234110 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234019 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/934e4c19-32e3-4339-a015-0cb04970cd53-multus-daemon-config\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.234110 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234034 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7tjv\" (UniqueName: \"kubernetes.io/projected/ecc3701f-7faf-4848-bb1f-09ff724650d0-kube-api-access-v7tjv\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.234110 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234074 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-run-netns\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.234110 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234101 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6l9v\" (UniqueName: \"kubernetes.io/projected/21f24bca-f445-422b-a668-8ba349c814f0-kube-api-access-j6l9v\") pod \"iptables-alerter-phjvd\" (UID: \"21f24bca-f445-422b-a668-8ba349c814f0\") " pod="openshift-network-operator/iptables-alerter-phjvd" Jul 03 19:10:22.234392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234119 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-etc-openvswitch\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.234392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234140 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-run-openvswitch\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.234392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234176 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-var-lib-kubelet\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.234392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234205 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-hostroot\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.234392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234229 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjvj\" (UniqueName: \"kubernetes.io/projected/934e4c19-32e3-4339-a015-0cb04970cd53-kube-api-access-xrjvj\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.234392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234253 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:22.234392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234281 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-kubelet\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.234392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234308 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-run-ovn\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.234392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234327 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-cnibin\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.234392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234349 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57a524e0-ad2c-406e-a6bf-1e2284235fc5-cnibin\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.234392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234372 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn62s\" (UniqueName: \"kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s\") pod \"network-check-target-jkr57\" (UID: \"9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8\") " pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234404 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-systemd-units\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234422 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ecc3701f-7faf-4848-bb1f-09ff724650d0-env-overrides\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234439 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-multus-socket-dir-parent\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234462 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zp2v\" (UniqueName: \"kubernetes.io/projected/003930ac-166e-4958-b6e8-30444b6e6fec-kube-api-access-6zp2v\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234482 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8671be47-a9a5-4fd4-b103-a00d3c53b2ff-konnectivity-ca\") pod \"konnectivity-agent-cjbmx\" (UID: \"8671be47-a9a5-4fd4-b103-a00d3c53b2ff\") " pod="kube-system/konnectivity-agent-cjbmx" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234498 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21f24bca-f445-422b-a668-8ba349c814f0-iptables-alerter-script\") pod \"iptables-alerter-phjvd\" (UID: \"21f24bca-f445-422b-a668-8ba349c814f0\") " pod="openshift-network-operator/iptables-alerter-phjvd" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234513 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-node-log\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234531 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57a524e0-ad2c-406e-a6bf-1e2284235fc5-os-release\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234561 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57a524e0-ad2c-406e-a6bf-1e2284235fc5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234579 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-slash\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234595 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecc3701f-7faf-4848-bb1f-09ff724650d0-ovn-node-metrics-cert\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234615 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-multus-conf-dir\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.234794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234631 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-cni-netd\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234647 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-run-k8s-cni-cncf-io\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234662 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-run-systemd\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234688 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ecc3701f-7faf-4848-bb1f-09ff724650d0-ovnkube-config\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234707 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57a524e0-ad2c-406e-a6bf-1e2284235fc5-cni-binary-copy\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234724 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57a524e0-ad2c-406e-a6bf-1e2284235fc5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234739 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmsl2\" (UniqueName: \"kubernetes.io/projected/57a524e0-ad2c-406e-a6bf-1e2284235fc5-kube-api-access-gmsl2\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234761 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234786 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-run-netns\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234805 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-var-lib-openvswitch\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234846 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-log-socket\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234899 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-var-lib-cni-bin\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234940 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21f24bca-f445-422b-a668-8ba349c814f0-host-slash\") pod \"iptables-alerter-phjvd\" (UID: \"21f24bca-f445-422b-a668-8ba349c814f0\") " pod="openshift-network-operator/iptables-alerter-phjvd" Jul 03 19:10:22.235342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234966 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8d28707-c79a-489a-aef0-b389707b64c1-dbus\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:22.235948 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.234996 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57a524e0-ad2c-406e-a6bf-1e2284235fc5-system-cni-dir\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.235948 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.235020 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.235948 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.235049 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.235948 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.235076 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8671be47-a9a5-4fd4-b103-a00d3c53b2ff-agent-certs\") pod \"konnectivity-agent-cjbmx\" (UID: \"8671be47-a9a5-4fd4-b103-a00d3c53b2ff\") " pod="kube-system/konnectivity-agent-cjbmx" Jul 03 19:10:22.235948 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.235129 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-run-multus-certs\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.235948 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.235158 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-etc-kubernetes\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.235948 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.235186 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-cni-bin\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.258745 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.258720 2587 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x7tfx" Jul 03 19:10:22.264598 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.264581 2587 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x7tfx" Jul 03 19:10:22.321883 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.321866 2587 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 03 19:10:22.335873 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.335838 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.335975 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.335885 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8671be47-a9a5-4fd4-b103-a00d3c53b2ff-agent-certs\") pod \"konnectivity-agent-cjbmx\" (UID: \"8671be47-a9a5-4fd4-b103-a00d3c53b2ff\") " pod="kube-system/konnectivity-agent-cjbmx" Jul 03 19:10:22.335975 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.335914 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.335975 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.335916 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-run-multus-certs\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.335975 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.335964 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-etc-kubernetes\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.336165 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.335987 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-socket-dir\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.336165 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336005 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-cni-bin\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.336165 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336026 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-system-cni-dir\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.336165 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336050 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-os-release\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.336165 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336065 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-run-multus-certs\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.336165 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336095 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-var-lib-cni-multus\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.336165 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336123 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-cni-bin\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.336165 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336126 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57a524e0-ad2c-406e-a6bf-1e2284235fc5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.336165 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336130 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-os-release\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336171 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8d28707-c79a-489a-aef0-b389707b64c1-kubelet-config\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336185 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-var-lib-cni-multus\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336235 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-lib-modules\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336246 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-etc-kubernetes\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336248 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e8d28707-c79a-489a-aef0-b389707b64c1-kubelet-config\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336274 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ab8136f-f23c-4901-9e0a-79a8608d73ed-tmp\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336294 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/934e4c19-32e3-4339-a015-0cb04970cd53-cni-binary-copy\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336290 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-system-cni-dir\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336314 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4kgw\" (UniqueName: \"kubernetes.io/projected/c830d1f0-68af-4eaf-aab8-ede043da7c02-kube-api-access-k4kgw\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336332 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-var-lib-kubelet\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336346 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbb9f0b3-b16c-43e8-84a9-2d79872585fa-host\") pod \"node-ca-hdp8t\" (UID: \"dbb9f0b3-b16c-43e8-84a9-2d79872585fa\") " pod="openshift-image-registry/node-ca-hdp8t" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336376 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ecc3701f-7faf-4848-bb1f-09ff724650d0-ovnkube-script-lib\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336433 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-multus-cni-dir\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.336556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336454 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/934e4c19-32e3-4339-a015-0cb04970cd53-multus-daemon-config\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336472 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-sysctl-d\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336491 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-systemd\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336513 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-run\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336537 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7tjv\" (UniqueName: \"kubernetes.io/projected/ecc3701f-7faf-4848-bb1f-09ff724650d0-kube-api-access-v7tjv\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336564 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-run-netns\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336590 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6l9v\" (UniqueName: \"kubernetes.io/projected/21f24bca-f445-422b-a668-8ba349c814f0-kube-api-access-j6l9v\") pod \"iptables-alerter-phjvd\" (UID: \"21f24bca-f445-422b-a668-8ba349c814f0\") " pod="openshift-network-operator/iptables-alerter-phjvd" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336618 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb073b99-db12-43df-b79c-f1ae057356cf-tmp-dir\") pod \"node-resolver-snbdp\" (UID: \"eb073b99-db12-43df-b79c-f1ae057356cf\") " pod="openshift-dns/node-resolver-snbdp" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336635 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-run-netns\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336675 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dbb9f0b3-b16c-43e8-84a9-2d79872585fa-serviceca\") pod \"node-ca-hdp8t\" (UID: \"dbb9f0b3-b16c-43e8-84a9-2d79872585fa\") " pod="openshift-image-registry/node-ca-hdp8t" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336706 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-etc-openvswitch\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336732 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-run-openvswitch\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336761 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-var-lib-kubelet\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336787 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-hostroot\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336856 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-run-openvswitch\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.337340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336857 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-etc-openvswitch\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336896 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-var-lib-kubelet\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336904 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-hostroot\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336926 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-sysctl-conf\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336971 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-sys\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.336982 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-multus-cni-dir\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337005 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjvj\" (UniqueName: \"kubernetes.io/projected/934e4c19-32e3-4339-a015-0cb04970cd53-kube-api-access-xrjvj\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337036 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/934e4c19-32e3-4339-a015-0cb04970cd53-multus-daemon-config\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337041 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337084 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/934e4c19-32e3-4339-a015-0cb04970cd53-cni-binary-copy\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337103 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-registration-dir\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337145 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-etc-selinux\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.337156 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337178 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-kubelet\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.337962 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.337213 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret podName:e8d28707-c79a-489a-aef0-b389707b64c1 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:22.837193287 +0000 UTC m=+2.984845538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret") pod "global-pull-secret-syncer-lh4kg" (UID: "e8d28707-c79a-489a-aef0-b389707b64c1") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337232 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-run-ovn\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337242 2587 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337251 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ecc3701f-7faf-4848-bb1f-09ff724650d0-ovnkube-script-lib\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337265 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-kubelet\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337308 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-cnibin\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337335 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57a524e0-ad2c-406e-a6bf-1e2284235fc5-cnibin\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337378 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-cnibin\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337374 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn62s\" (UniqueName: \"kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s\") pod \"network-check-target-jkr57\" (UID: \"9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8\") " pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337408 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/57a524e0-ad2c-406e-a6bf-1e2284235fc5-cnibin\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337456 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-run-ovn\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337498 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-systemd-units\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337528 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ecc3701f-7faf-4848-bb1f-09ff724650d0-env-overrides\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337556 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-sysconfig\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337590 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-multus-socket-dir-parent\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.338699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337594 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-systemd-units\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337643 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-multus-socket-dir-parent\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337677 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-tuned\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337717 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79qld\" (UniqueName: \"kubernetes.io/projected/0ab8136f-f23c-4901-9e0a-79a8608d73ed-kube-api-access-79qld\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337746 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zp2v\" (UniqueName: \"kubernetes.io/projected/003930ac-166e-4958-b6e8-30444b6e6fec-kube-api-access-6zp2v\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337795 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8671be47-a9a5-4fd4-b103-a00d3c53b2ff-konnectivity-ca\") pod \"konnectivity-agent-cjbmx\" (UID: \"8671be47-a9a5-4fd4-b103-a00d3c53b2ff\") " pod="kube-system/konnectivity-agent-cjbmx" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337932 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21f24bca-f445-422b-a668-8ba349c814f0-iptables-alerter-script\") pod \"iptables-alerter-phjvd\" (UID: \"21f24bca-f445-422b-a668-8ba349c814f0\") " pod="openshift-network-operator/iptables-alerter-phjvd" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338019 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ecc3701f-7faf-4848-bb1f-09ff724650d0-env-overrides\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.337993 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb073b99-db12-43df-b79c-f1ae057356cf-hosts-file\") pod \"node-resolver-snbdp\" (UID: \"eb073b99-db12-43df-b79c-f1ae057356cf\") " pod="openshift-dns/node-resolver-snbdp" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338509 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-node-log\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338536 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57a524e0-ad2c-406e-a6bf-1e2284235fc5-os-release\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338565 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57a524e0-ad2c-406e-a6bf-1e2284235fc5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338581 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8671be47-a9a5-4fd4-b103-a00d3c53b2ff-konnectivity-ca\") pod \"konnectivity-agent-cjbmx\" (UID: \"8671be47-a9a5-4fd4-b103-a00d3c53b2ff\") " pod="kube-system/konnectivity-agent-cjbmx" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338599 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-device-dir\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.339292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338606 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/57a524e0-ad2c-406e-a6bf-1e2284235fc5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338606 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21f24bca-f445-422b-a668-8ba349c814f0-iptables-alerter-script\") pod \"iptables-alerter-phjvd\" (UID: \"21f24bca-f445-422b-a668-8ba349c814f0\") " pod="openshift-network-operator/iptables-alerter-phjvd" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338625 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-sys-fs\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338644 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/57a524e0-ad2c-406e-a6bf-1e2284235fc5-os-release\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338653 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-kubernetes\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338765 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-node-log\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338823 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-slash\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338848 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecc3701f-7faf-4848-bb1f-09ff724650d0-ovn-node-metrics-cert\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338864 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-multus-conf-dir\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338885 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-modprobe-d\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338908 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-host\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338932 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-cni-netd\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338951 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-slash\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338952 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-multus-conf-dir\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.339956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.338962 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-run-k8s-cni-cncf-io\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339005 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-cni-netd\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339013 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-run-k8s-cni-cncf-io\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339023 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52z2x\" (UniqueName: \"kubernetes.io/projected/eb073b99-db12-43df-b79c-f1ae057356cf-kube-api-access-52z2x\") pod \"node-resolver-snbdp\" (UID: \"eb073b99-db12-43df-b79c-f1ae057356cf\") " pod="openshift-dns/node-resolver-snbdp" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339039 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/57a524e0-ad2c-406e-a6bf-1e2284235fc5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339079 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-run-systemd\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339106 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ecc3701f-7faf-4848-bb1f-09ff724650d0-ovnkube-config\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339131 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57a524e0-ad2c-406e-a6bf-1e2284235fc5-cni-binary-copy\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339144 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-run-systemd\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339156 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57a524e0-ad2c-406e-a6bf-1e2284235fc5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339181 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmsl2\" (UniqueName: \"kubernetes.io/projected/57a524e0-ad2c-406e-a6bf-1e2284235fc5-kube-api-access-gmsl2\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339199 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47758\" (UniqueName: \"kubernetes.io/projected/dbb9f0b3-b16c-43e8-84a9-2d79872585fa-kube-api-access-47758\") pod \"node-ca-hdp8t\" (UID: \"dbb9f0b3-b16c-43e8-84a9-2d79872585fa\") " pod="openshift-image-registry/node-ca-hdp8t" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339231 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339257 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-run-netns\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.340387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339282 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-var-lib-openvswitch\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339304 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-log-socket\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339327 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-var-lib-cni-bin\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339348 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21f24bca-f445-422b-a668-8ba349c814f0-host-slash\") pod \"iptables-alerter-phjvd\" (UID: \"21f24bca-f445-422b-a668-8ba349c814f0\") " pod="openshift-network-operator/iptables-alerter-phjvd" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339369 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8d28707-c79a-489a-aef0-b389707b64c1-dbus\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339389 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339413 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57a524e0-ad2c-406e-a6bf-1e2284235fc5-system-cni-dir\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339437 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339516 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-var-lib-openvswitch\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339534 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339580 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-log-socket\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339633 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/934e4c19-32e3-4339-a015-0cb04970cd53-host-var-lib-cni-bin\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339649 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ecc3701f-7faf-4848-bb1f-09ff724650d0-ovnkube-config\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339678 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21f24bca-f445-422b-a668-8ba349c814f0-host-slash\") pod \"iptables-alerter-phjvd\" (UID: \"21f24bca-f445-422b-a668-8ba349c814f0\") " pod="openshift-network-operator/iptables-alerter-phjvd" Jul 03 19:10:22.340807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339733 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e8d28707-c79a-489a-aef0-b389707b64c1-dbus\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:22.341338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339762 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecc3701f-7faf-4848-bb1f-09ff724650d0-host-run-netns\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.341338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339787 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/57a524e0-ad2c-406e-a6bf-1e2284235fc5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.341338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339789 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/57a524e0-ad2c-406e-a6bf-1e2284235fc5-system-cni-dir\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.341338 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.339883 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:22.341338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.339899 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/57a524e0-ad2c-406e-a6bf-1e2284235fc5-cni-binary-copy\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.341338 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.339948 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs podName:003930ac-166e-4958-b6e8-30444b6e6fec nodeName:}" failed. No retries permitted until 2026-07-03 19:10:22.839930224 +0000 UTC m=+2.987582462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs") pod "network-metrics-daemon-dnsmw" (UID: "003930ac-166e-4958-b6e8-30444b6e6fec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:22.341338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.341182 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8671be47-a9a5-4fd4-b103-a00d3c53b2ff-agent-certs\") pod \"konnectivity-agent-cjbmx\" (UID: \"8671be47-a9a5-4fd4-b103-a00d3c53b2ff\") " pod="kube-system/konnectivity-agent-cjbmx" Jul 03 19:10:22.341338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.341209 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecc3701f-7faf-4848-bb1f-09ff724650d0-ovn-node-metrics-cert\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.346487 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.346452 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:22.346487 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.346479 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:22.346661 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.346502 2587 projected.go:196] Error preparing data for projected volume kube-api-access-kn62s for pod openshift-network-diagnostics/network-check-target-jkr57: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:22.346661 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.346568 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s podName:9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:22.846550857 +0000 UTC m=+2.994203121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kn62s" (UniqueName: "kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s") pod "network-check-target-jkr57" (UID: "9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:22.347958 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.347935 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6l9v\" (UniqueName: \"kubernetes.io/projected/21f24bca-f445-422b-a668-8ba349c814f0-kube-api-access-j6l9v\") pod \"iptables-alerter-phjvd\" (UID: \"21f24bca-f445-422b-a668-8ba349c814f0\") " pod="openshift-network-operator/iptables-alerter-phjvd" Jul 03 19:10:22.348730 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.348701 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjvj\" (UniqueName: \"kubernetes.io/projected/934e4c19-32e3-4339-a015-0cb04970cd53-kube-api-access-xrjvj\") pod \"multus-lv8dm\" (UID: \"934e4c19-32e3-4339-a015-0cb04970cd53\") " pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.349108 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.349088 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zp2v\" (UniqueName: \"kubernetes.io/projected/003930ac-166e-4958-b6e8-30444b6e6fec-kube-api-access-6zp2v\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:22.349184 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.349144 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7tjv\" (UniqueName: \"kubernetes.io/projected/ecc3701f-7faf-4848-bb1f-09ff724650d0-kube-api-access-v7tjv\") pod \"ovnkube-node-qvdx5\" (UID: \"ecc3701f-7faf-4848-bb1f-09ff724650d0\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.349457 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.349431 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmsl2\" (UniqueName: \"kubernetes.io/projected/57a524e0-ad2c-406e-a6bf-1e2284235fc5-kube-api-access-gmsl2\") pod \"multus-additional-cni-plugins-9mxvx\" (UID: \"57a524e0-ad2c-406e-a6bf-1e2284235fc5\") " pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.439817 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.439787 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.440041 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.439833 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-socket-dir\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.440041 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.439870 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-lib-modules\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.440041 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.439895 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ab8136f-f23c-4901-9e0a-79a8608d73ed-tmp\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.440041 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.439932 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.440041 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.439983 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4kgw\" (UniqueName: \"kubernetes.io/projected/c830d1f0-68af-4eaf-aab8-ede043da7c02-kube-api-access-k4kgw\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.440041 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.439993 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-lib-modules\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.440041 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440005 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-socket-dir\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.440041 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440034 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-var-lib-kubelet\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440065 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbb9f0b3-b16c-43e8-84a9-2d79872585fa-host\") pod \"node-ca-hdp8t\" (UID: \"dbb9f0b3-b16c-43e8-84a9-2d79872585fa\") " pod="openshift-image-registry/node-ca-hdp8t" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440093 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-sysctl-d\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440115 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-systemd\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440138 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-run\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440166 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb073b99-db12-43df-b79c-f1ae057356cf-tmp-dir\") pod \"node-resolver-snbdp\" (UID: \"eb073b99-db12-43df-b79c-f1ae057356cf\") " pod="openshift-dns/node-resolver-snbdp" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440190 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dbb9f0b3-b16c-43e8-84a9-2d79872585fa-serviceca\") pod \"node-ca-hdp8t\" (UID: \"dbb9f0b3-b16c-43e8-84a9-2d79872585fa\") " pod="openshift-image-registry/node-ca-hdp8t" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440219 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-sysctl-conf\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440245 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-sys\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440250 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-systemd\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440257 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-run\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440303 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbb9f0b3-b16c-43e8-84a9-2d79872585fa-host\") pod \"node-ca-hdp8t\" (UID: \"dbb9f0b3-b16c-43e8-84a9-2d79872585fa\") " pod="openshift-image-registry/node-ca-hdp8t" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440353 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-registration-dir\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440369 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-sysctl-conf\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440383 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-etc-selinux\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.440469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440402 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-sys\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440429 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-sysconfig\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440440 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-registration-dir\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440457 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-tuned\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440519 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-sysconfig\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440587 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-var-lib-kubelet\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440592 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79qld\" (UniqueName: \"kubernetes.io/projected/0ab8136f-f23c-4901-9e0a-79a8608d73ed-kube-api-access-79qld\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440649 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb073b99-db12-43df-b79c-f1ae057356cf-hosts-file\") pod \"node-resolver-snbdp\" (UID: \"eb073b99-db12-43df-b79c-f1ae057356cf\") " pod="openshift-dns/node-resolver-snbdp" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440680 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-device-dir\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440708 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-sys-fs\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440736 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-kubernetes\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440749 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-etc-selinux\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440764 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-modprobe-d\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440802 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-host\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440832 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52z2x\" (UniqueName: \"kubernetes.io/projected/eb073b99-db12-43df-b79c-f1ae057356cf-kube-api-access-52z2x\") pod \"node-resolver-snbdp\" (UID: \"eb073b99-db12-43df-b79c-f1ae057356cf\") " pod="openshift-dns/node-resolver-snbdp" Jul 03 19:10:22.441823 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440856 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-device-dir\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.441823 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440866 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47758\" (UniqueName: \"kubernetes.io/projected/dbb9f0b3-b16c-43e8-84a9-2d79872585fa-kube-api-access-47758\") pod \"node-ca-hdp8t\" (UID: \"dbb9f0b3-b16c-43e8-84a9-2d79872585fa\") " pod="openshift-image-registry/node-ca-hdp8t" Jul 03 19:10:22.441823 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.441120 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eb073b99-db12-43df-b79c-f1ae057356cf-hosts-file\") pod \"node-resolver-snbdp\" (UID: \"eb073b99-db12-43df-b79c-f1ae057356cf\") " pod="openshift-dns/node-resolver-snbdp" Jul 03 19:10:22.441823 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.440683 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-sysctl-d\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441823 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.441190 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb073b99-db12-43df-b79c-f1ae057356cf-tmp-dir\") pod \"node-resolver-snbdp\" (UID: \"eb073b99-db12-43df-b79c-f1ae057356cf\") " pod="openshift-dns/node-resolver-snbdp" Jul 03 19:10:22.441823 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.441229 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-host\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441823 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.441259 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-kubernetes\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441823 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.441312 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-modprobe-d\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.441823 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.441383 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dbb9f0b3-b16c-43e8-84a9-2d79872585fa-serviceca\") pod \"node-ca-hdp8t\" (UID: \"dbb9f0b3-b16c-43e8-84a9-2d79872585fa\") " pod="openshift-image-registry/node-ca-hdp8t" Jul 03 19:10:22.441823 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.441401 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c830d1f0-68af-4eaf-aab8-ede043da7c02-sys-fs\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.442467 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.442447 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ab8136f-f23c-4901-9e0a-79a8608d73ed-tmp\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.442644 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.442628 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ab8136f-f23c-4901-9e0a-79a8608d73ed-etc-tuned\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.449461 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.449439 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79qld\" (UniqueName: \"kubernetes.io/projected/0ab8136f-f23c-4901-9e0a-79a8608d73ed-kube-api-access-79qld\") pod \"tuned-zcjbt\" (UID: \"0ab8136f-f23c-4901-9e0a-79a8608d73ed\") " pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.449582 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.449472 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52z2x\" (UniqueName: \"kubernetes.io/projected/eb073b99-db12-43df-b79c-f1ae057356cf-kube-api-access-52z2x\") pod \"node-resolver-snbdp\" (UID: \"eb073b99-db12-43df-b79c-f1ae057356cf\") " pod="openshift-dns/node-resolver-snbdp" Jul 03 19:10:22.449582 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.449479 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4kgw\" (UniqueName: \"kubernetes.io/projected/c830d1f0-68af-4eaf-aab8-ede043da7c02-kube-api-access-k4kgw\") pod \"aws-ebs-csi-driver-node-77cxp\" (UID: \"c830d1f0-68af-4eaf-aab8-ede043da7c02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.449582 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.449511 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47758\" (UniqueName: \"kubernetes.io/projected/dbb9f0b3-b16c-43e8-84a9-2d79872585fa-kube-api-access-47758\") pod \"node-ca-hdp8t\" (UID: \"dbb9f0b3-b16c-43e8-84a9-2d79872585fa\") " pod="openshift-image-registry/node-ca-hdp8t" Jul 03 19:10:22.519224 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:22.519181 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85fde282788a9bf74b4b07459943d969.slice/crio-d4b614fa198e216a64f7bbbc8ca537c01ec7408e6c6072e6fe946a31b8bd2c62 WatchSource:0}: Error finding container d4b614fa198e216a64f7bbbc8ca537c01ec7408e6c6072e6fe946a31b8bd2c62: Status 404 returned error can't find the container with id d4b614fa198e216a64f7bbbc8ca537c01ec7408e6c6072e6fe946a31b8bd2c62 Jul 03 19:10:22.523581 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:22.523528 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81e294d243496cfd6a8dce82cfccf39.slice/crio-d19ef2017f2ddf61d69f49f64082ff090c2b3ddd6b436cee58fdb05bc68a5785 WatchSource:0}: Error finding container d19ef2017f2ddf61d69f49f64082ff090c2b3ddd6b436cee58fdb05bc68a5785: Status 404 returned error can't find the container with id d19ef2017f2ddf61d69f49f64082ff090c2b3ddd6b436cee58fdb05bc68a5785 Jul 03 19:10:22.524151 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.524116 2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 19:10:22.547408 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.547383 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" Jul 03 19:10:22.557866 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:22.557839 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a524e0_ad2c_406e_a6bf_1e2284235fc5.slice/crio-502110b22f6c74941285db50e7ab16115100f9d6aaf242f1af134bb397ae79bc WatchSource:0}: Error finding container 502110b22f6c74941285db50e7ab16115100f9d6aaf242f1af134bb397ae79bc: Status 404 returned error can't find the container with id 502110b22f6c74941285db50e7ab16115100f9d6aaf242f1af134bb397ae79bc Jul 03 19:10:22.563138 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.563121 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lv8dm" Jul 03 19:10:22.571580 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:22.571552 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod934e4c19_32e3_4339_a015_0cb04970cd53.slice/crio-8658342f4305b01337646e6d8d43276cc65e2ee3a3b0288d3e3de5caf53b7b9c WatchSource:0}: Error finding container 8658342f4305b01337646e6d8d43276cc65e2ee3a3b0288d3e3de5caf53b7b9c: Status 404 returned error can't find the container with id 8658342f4305b01337646e6d8d43276cc65e2ee3a3b0288d3e3de5caf53b7b9c Jul 03 19:10:22.580416 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.580397 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-phjvd" Jul 03 19:10:22.589083 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:22.589057 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f24bca_f445_422b_a668_8ba349c814f0.slice/crio-329f3ed6df845b2e2ffb2c2d8fdad697ec4be5f2b21fa3d21ea05b3408f28635 WatchSource:0}: Error finding container 329f3ed6df845b2e2ffb2c2d8fdad697ec4be5f2b21fa3d21ea05b3408f28635: Status 404 returned error can't find the container with id 329f3ed6df845b2e2ffb2c2d8fdad697ec4be5f2b21fa3d21ea05b3408f28635 Jul 03 19:10:22.602236 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.602215 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:22.612156 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:22.612134 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc3701f_7faf_4848_bb1f_09ff724650d0.slice/crio-7b2746dfc5820622cc28fee9140b71d9d0a19227cf6d9b7acc176d97e1569a50 WatchSource:0}: Error finding container 7b2746dfc5820622cc28fee9140b71d9d0a19227cf6d9b7acc176d97e1569a50: Status 404 returned error can't find the container with id 7b2746dfc5820622cc28fee9140b71d9d0a19227cf6d9b7acc176d97e1569a50 Jul 03 19:10:22.624110 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.624092 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cjbmx" Jul 03 19:10:22.633167 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:22.633141 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8671be47_a9a5_4fd4_b103_a00d3c53b2ff.slice/crio-131c44e04edf9d0e7332bc9a1c35e72a9be07fb67dda59f1e5316f6f1c8dc6a1 WatchSource:0}: Error finding container 131c44e04edf9d0e7332bc9a1c35e72a9be07fb67dda59f1e5316f6f1c8dc6a1: Status 404 returned error can't find the container with id 131c44e04edf9d0e7332bc9a1c35e72a9be07fb67dda59f1e5316f6f1c8dc6a1 Jul 03 19:10:22.641623 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.641604 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" Jul 03 19:10:22.649852 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:22.649831 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc830d1f0_68af_4eaf_aab8_ede043da7c02.slice/crio-20b75fdc32c07d38f268deb16b41a21f2d643fbac62543e6ddf255c48e8e01bf WatchSource:0}: Error finding container 20b75fdc32c07d38f268deb16b41a21f2d643fbac62543e6ddf255c48e8e01bf: Status 404 returned error can't find the container with id 20b75fdc32c07d38f268deb16b41a21f2d643fbac62543e6ddf255c48e8e01bf Jul 03 19:10:22.660759 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.660741 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" Jul 03 19:10:22.669152 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:22.669128 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab8136f_f23c_4901_9e0a_79a8608d73ed.slice/crio-b8dc3cd533ddcd7c931ae865e263e7decd49e9f161073e1ad4a25d965662b8d5 WatchSource:0}: Error finding container b8dc3cd533ddcd7c931ae865e263e7decd49e9f161073e1ad4a25d965662b8d5: Status 404 returned error can't find the container with id b8dc3cd533ddcd7c931ae865e263e7decd49e9f161073e1ad4a25d965662b8d5 Jul 03 19:10:22.692778 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.692755 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-snbdp" Jul 03 19:10:22.697073 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.697054 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hdp8t" Jul 03 19:10:22.702070 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:22.702046 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb073b99_db12_43df_b79c_f1ae057356cf.slice/crio-8293d46d6634083ec0288736d4de2a37a92ac44c23a309f39a993488ddd64b46 WatchSource:0}: Error finding container 8293d46d6634083ec0288736d4de2a37a92ac44c23a309f39a993488ddd64b46: Status 404 returned error can't find the container with id 8293d46d6634083ec0288736d4de2a37a92ac44c23a309f39a993488ddd64b46 Jul 03 19:10:22.707025 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:22.707003 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb9f0b3_b16c_43e8_84a9_2d79872585fa.slice/crio-4ee60cc573c285ebe617d7ab84dd32f9ec238dc502d2517c32bf26b324932012 WatchSource:0}: Error finding container 4ee60cc573c285ebe617d7ab84dd32f9ec238dc502d2517c32bf26b324932012: Status 404 returned error can't find the container with id 4ee60cc573c285ebe617d7ab84dd32f9ec238dc502d2517c32bf26b324932012 Jul 03 19:10:22.708698 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.708681 2587 kuberuntime_manager.go:1459] "Unhandled Error" err="container node-ca start failed in pod node-ca-hdp8t_openshift-image-registry(dbb9f0b3-b16c-43e8-84a9-2d79872585fa): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 03 19:10:22.708760 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.708712 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-image-registry/node-ca-hdp8t" podUID="dbb9f0b3-b16c-43e8-84a9-2d79872585fa" Jul 03 19:10:22.843775 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.843744 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:22.843966 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.843818 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:22.843966 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.843907 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:22.843966 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.843934 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:22.844086 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.843973 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs podName:003930ac-166e-4958-b6e8-30444b6e6fec nodeName:}" failed. No retries permitted until 2026-07-03 19:10:23.843955829 +0000 UTC m=+3.991608072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs") pod "network-metrics-daemon-dnsmw" (UID: "003930ac-166e-4958-b6e8-30444b6e6fec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:22.844086 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.843989 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret podName:e8d28707-c79a-489a-aef0-b389707b64c1 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:23.843982468 +0000 UTC m=+3.991634708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret") pod "global-pull-secret-syncer-lh4kg" (UID: "e8d28707-c79a-489a-aef0-b389707b64c1") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:22.945128 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:22.945100 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn62s\" (UniqueName: \"kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s\") pod \"network-check-target-jkr57\" (UID: \"9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8\") " pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:22.945278 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.945237 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:22.945278 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.945251 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:22.945278 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.945260 2587 projected.go:196] Error preparing data for projected volume kube-api-access-kn62s for pod openshift-network-diagnostics/network-check-target-jkr57: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:22.945396 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:22.945305 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s podName:9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:23.945291826 +0000 UTC m=+4.092944063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kn62s" (UniqueName: "kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s") pod "network-check-target-jkr57" (UID: "9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:23.266336 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.266220 2587 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 19:05:22 +0000 UTC" deadline="2028-01-16 14:40:15.527375802 +0000 UTC" Jul 03 19:10:23.266336 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.266285 2587 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13483h29m52.2610957s" Jul 03 19:10:23.442948 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.442917 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:23.443139 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:23.443052 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:23.443501 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.443479 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:23.443630 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:23.443598 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:23.474360 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.474295 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hdp8t" event={"ID":"dbb9f0b3-b16c-43e8-84a9-2d79872585fa","Type":"ContainerStarted","Data":"4ee60cc573c285ebe617d7ab84dd32f9ec238dc502d2517c32bf26b324932012"} Jul 03 19:10:23.476302 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:23.476265 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"node-ca\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:60d76d51dac424f46a693b8b319b38803b48ebb091938c4153ffa0fafb50fd11\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-image-registry/node-ca-hdp8t" podUID="dbb9f0b3-b16c-43e8-84a9-2d79872585fa" Jul 03 19:10:23.482752 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.482701 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" event={"ID":"0ab8136f-f23c-4901-9e0a-79a8608d73ed","Type":"ContainerStarted","Data":"b8dc3cd533ddcd7c931ae865e263e7decd49e9f161073e1ad4a25d965662b8d5"} Jul 03 19:10:23.492356 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.492322 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" event={"ID":"c830d1f0-68af-4eaf-aab8-ede043da7c02","Type":"ContainerStarted","Data":"20b75fdc32c07d38f268deb16b41a21f2d643fbac62543e6ddf255c48e8e01bf"} Jul 03 19:10:23.501425 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.501393 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cjbmx" event={"ID":"8671be47-a9a5-4fd4-b103-a00d3c53b2ff","Type":"ContainerStarted","Data":"131c44e04edf9d0e7332bc9a1c35e72a9be07fb67dda59f1e5316f6f1c8dc6a1"} Jul 03 19:10:23.521120 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.521038 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" event={"ID":"ecc3701f-7faf-4848-bb1f-09ff724650d0","Type":"ContainerStarted","Data":"7b2746dfc5820622cc28fee9140b71d9d0a19227cf6d9b7acc176d97e1569a50"} Jul 03 19:10:23.538219 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.538182 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lv8dm" event={"ID":"934e4c19-32e3-4339-a015-0cb04970cd53","Type":"ContainerStarted","Data":"8658342f4305b01337646e6d8d43276cc65e2ee3a3b0288d3e3de5caf53b7b9c"} Jul 03 19:10:23.558396 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.558356 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" event={"ID":"57a524e0-ad2c-406e-a6bf-1e2284235fc5","Type":"ContainerStarted","Data":"502110b22f6c74941285db50e7ab16115100f9d6aaf242f1af134bb397ae79bc"} Jul 03 19:10:23.582936 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.582898 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-57.ec2.internal" event={"ID":"85fde282788a9bf74b4b07459943d969","Type":"ContainerStarted","Data":"d4b614fa198e216a64f7bbbc8ca537c01ec7408e6c6072e6fe946a31b8bd2c62"} Jul 03 19:10:23.594723 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.594687 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-snbdp" event={"ID":"eb073b99-db12-43df-b79c-f1ae057356cf","Type":"ContainerStarted","Data":"8293d46d6634083ec0288736d4de2a37a92ac44c23a309f39a993488ddd64b46"} Jul 03 19:10:23.598368 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.598332 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-phjvd" event={"ID":"21f24bca-f445-422b-a668-8ba349c814f0","Type":"ContainerStarted","Data":"329f3ed6df845b2e2ffb2c2d8fdad697ec4be5f2b21fa3d21ea05b3408f28635"} Jul 03 19:10:23.610960 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.610927 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" event={"ID":"b81e294d243496cfd6a8dce82cfccf39","Type":"ContainerStarted","Data":"d19ef2017f2ddf61d69f49f64082ff090c2b3ddd6b436cee58fdb05bc68a5785"} Jul 03 19:10:23.853645 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.853612 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:23.853861 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.853664 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:23.853861 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:23.853760 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:23.853861 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:23.853823 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret podName:e8d28707-c79a-489a-aef0-b389707b64c1 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:25.853808369 +0000 UTC m=+6.001460605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret") pod "global-pull-secret-syncer-lh4kg" (UID: "e8d28707-c79a-489a-aef0-b389707b64c1") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:23.854217 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:23.854199 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:23.854292 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:23.854254 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs podName:003930ac-166e-4958-b6e8-30444b6e6fec nodeName:}" failed. No retries permitted until 2026-07-03 19:10:25.85423746 +0000 UTC m=+6.001889700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs") pod "network-metrics-daemon-dnsmw" (UID: "003930ac-166e-4958-b6e8-30444b6e6fec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:23.954659 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:23.954612 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn62s\" (UniqueName: \"kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s\") pod \"network-check-target-jkr57\" (UID: \"9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8\") " pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:23.954873 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:23.954856 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:23.954949 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:23.954882 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:23.954949 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:23.954895 2587 projected.go:196] Error preparing data for projected volume kube-api-access-kn62s for pod openshift-network-diagnostics/network-check-target-jkr57: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:23.955045 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:23.954959 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s podName:9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:25.954940089 +0000 UTC m=+6.102592328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kn62s" (UniqueName: "kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s") pod "network-check-target-jkr57" (UID: "9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:24.266887 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:24.266790 2587 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 19:05:22 +0000 UTC" deadline="2028-02-15 03:22:53.74381364 +0000 UTC" Jul 03 19:10:24.266887 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:24.266829 2587 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14192h12m29.476988758s" Jul 03 19:10:24.440066 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:24.440032 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:24.440239 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:24.440155 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:25.444273 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:25.444246 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:25.444738 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:25.444378 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:25.444738 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:25.444723 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:25.444918 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:25.444835 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:25.871018 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:25.870980 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:25.871208 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:25.871062 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:25.871927 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:25.871278 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:25.871927 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:25.871397 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret podName:e8d28707-c79a-489a-aef0-b389707b64c1 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:29.871378053 +0000 UTC m=+10.019030291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret") pod "global-pull-secret-syncer-lh4kg" (UID: "e8d28707-c79a-489a-aef0-b389707b64c1") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:25.871927 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:25.871833 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:25.871927 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:25.871888 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs podName:003930ac-166e-4958-b6e8-30444b6e6fec nodeName:}" failed. No retries permitted until 2026-07-03 19:10:29.871872019 +0000 UTC m=+10.019524259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs") pod "network-metrics-daemon-dnsmw" (UID: "003930ac-166e-4958-b6e8-30444b6e6fec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:25.972140 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:25.971935 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn62s\" (UniqueName: \"kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s\") pod \"network-check-target-jkr57\" (UID: \"9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8\") " pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:25.972140 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:25.972092 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:25.972140 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:25.972116 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:25.972140 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:25.972129 2587 projected.go:196] Error preparing data for projected volume kube-api-access-kn62s for pod openshift-network-diagnostics/network-check-target-jkr57: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:25.972463 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:25.972190 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s podName:9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:29.972171427 +0000 UTC m=+10.119823676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kn62s" (UniqueName: "kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s") pod "network-check-target-jkr57" (UID: "9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:26.439816 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:26.439699 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:26.440015 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:26.439848 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:27.439930 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:27.439750 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:27.439930 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:27.439904 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:27.440584 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:27.440338 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:27.440584 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:27.440452 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:28.440162 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:28.440125 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:28.440604 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:28.440267 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:29.440298 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:29.440263 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:29.440728 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:29.440401 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:29.440837 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:29.440747 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:29.440896 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:29.440871 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:29.901799 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:29.901741 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:29.901985 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:29.901825 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:29.901985 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:29.901947 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:29.901985 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:29.901963 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:29.902152 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:29.902003 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret podName:e8d28707-c79a-489a-aef0-b389707b64c1 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:37.901990656 +0000 UTC m=+18.049642892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret") pod "global-pull-secret-syncer-lh4kg" (UID: "e8d28707-c79a-489a-aef0-b389707b64c1") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:29.902152 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:29.902029 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs podName:003930ac-166e-4958-b6e8-30444b6e6fec nodeName:}" failed. No retries permitted until 2026-07-03 19:10:37.902010592 +0000 UTC m=+18.049662831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs") pod "network-metrics-daemon-dnsmw" (UID: "003930ac-166e-4958-b6e8-30444b6e6fec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:30.002211 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:30.002162 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn62s\" (UniqueName: \"kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s\") pod \"network-check-target-jkr57\" (UID: \"9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8\") " pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:30.002383 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:30.002335 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:30.002383 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:30.002355 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:30.002383 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:30.002369 2587 projected.go:196] Error preparing data for projected volume kube-api-access-kn62s for pod openshift-network-diagnostics/network-check-target-jkr57: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:30.002571 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:30.002434 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s podName:9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:38.002416881 +0000 UTC m=+18.150069119 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kn62s" (UniqueName: "kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s") pod "network-check-target-jkr57" (UID: "9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:30.439481 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:30.439433 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:30.439674 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:30.439563 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:31.440610 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:31.440577 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:31.441093 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:31.440679 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:31.441093 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:31.440831 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:31.441093 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:31.440954 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:32.440308 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:32.440273 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:32.440489 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:32.440416 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:33.439703 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:33.439660 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:33.440182 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:33.439657 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:33.440182 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:33.439799 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:33.440182 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:33.439884 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:34.440010 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:34.439973 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:34.440422 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:34.440088 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:35.440470 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:35.440432 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:35.440885 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:35.440570 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:35.440885 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:35.440619 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:35.440885 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:35.440734 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:36.439516 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:36.439485 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:36.439725 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:36.439685 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:37.440095 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:37.440060 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:37.440520 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:37.440198 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:37.440520 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:37.440251 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:37.440520 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:37.440375 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:37.966287 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:37.966245 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:37.966794 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:37.966639 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:37.966794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:37.966676 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:37.966794 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:37.966736 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret podName:e8d28707-c79a-489a-aef0-b389707b64c1 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:53.966714624 +0000 UTC m=+34.114366862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret") pod "global-pull-secret-syncer-lh4kg" (UID: "e8d28707-c79a-489a-aef0-b389707b64c1") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:37.967024 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:37.966840 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:37.967024 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:37.966914 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs podName:003930ac-166e-4958-b6e8-30444b6e6fec nodeName:}" failed. No retries permitted until 2026-07-03 19:10:53.966897129 +0000 UTC m=+34.114549370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs") pod "network-metrics-daemon-dnsmw" (UID: "003930ac-166e-4958-b6e8-30444b6e6fec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:38.068114 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:38.068073 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn62s\" (UniqueName: \"kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s\") pod \"network-check-target-jkr57\" (UID: \"9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8\") " pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:38.068297 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:38.068222 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:38.068297 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:38.068237 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:38.068297 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:38.068248 2587 projected.go:196] Error preparing data for projected volume kube-api-access-kn62s for pod openshift-network-diagnostics/network-check-target-jkr57: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:38.068453 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:38.068312 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s podName:9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8 nodeName:}" failed. No retries permitted until 2026-07-03 19:10:54.068295051 +0000 UTC m=+34.215947289 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kn62s" (UniqueName: "kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s") pod "network-check-target-jkr57" (UID: "9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:38.440129 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:38.440095 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:38.440614 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:38.440215 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:39.439953 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:39.439916 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:39.440107 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:39.440052 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:39.440185 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:39.440106 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:39.440472 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:39.440226 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:40.439496 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:40.439456 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:40.439686 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:40.439578 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:41.440125 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:41.440091 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:41.440554 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:41.440184 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:41.440554 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:41.440258 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:41.440554 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:41.440347 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:42.439658 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.439483 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:42.439795 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:42.439758 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:42.665010 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.664970 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lv8dm" event={"ID":"934e4c19-32e3-4339-a015-0cb04970cd53","Type":"ContainerStarted","Data":"351dd1db2c449029b8e7f3b64b5fa43286ff02ba0b2fc8e2ac21022d250ebdab"} Jul 03 19:10:42.666559 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.666528 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" event={"ID":"57a524e0-ad2c-406e-a6bf-1e2284235fc5","Type":"ContainerStarted","Data":"c63be3c7e402b16a6fdf76c7f70c35a7a91e940155465e2682674271c8af356c"} Jul 03 19:10:42.671627 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.671552 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-57.ec2.internal" event={"ID":"85fde282788a9bf74b4b07459943d969","Type":"ContainerStarted","Data":"19eb265ab6228b7a676f9d1826b1f77ca674d42806b4035fb3ff39255c2575f1"} Jul 03 19:10:42.673131 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.673089 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-snbdp" event={"ID":"eb073b99-db12-43df-b79c-f1ae057356cf","Type":"ContainerStarted","Data":"6a9aebf3fec880ee48d00c7954ee9f418fee2353f124bf986419c452a34a0a5e"} Jul 03 19:10:42.674726 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.674702 2587 generic.go:356] "Generic (PLEG): container finished" podID="b81e294d243496cfd6a8dce82cfccf39" containerID="61b721160cb3d9c5a2628ad0f19fb42c94e57987c41129b95c085da00d0056f1" exitCode=0 Jul 03 19:10:42.674860 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.674791 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" event={"ID":"b81e294d243496cfd6a8dce82cfccf39","Type":"ContainerDied","Data":"61b721160cb3d9c5a2628ad0f19fb42c94e57987c41129b95c085da00d0056f1"} Jul 03 19:10:42.676339 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.676315 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" event={"ID":"0ab8136f-f23c-4901-9e0a-79a8608d73ed","Type":"ContainerStarted","Data":"13fc964801e3fafa53ba794a039171afaac463ffecd5ee7e542ba943d9237292"} Jul 03 19:10:42.677817 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.677798 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" event={"ID":"c830d1f0-68af-4eaf-aab8-ede043da7c02","Type":"ContainerStarted","Data":"6225267331b52b63424ce8c1254c6e83ea3fdc1afe07a71ec0935abf12d97e39"} Jul 03 19:10:42.679194 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.679172 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cjbmx" event={"ID":"8671be47-a9a5-4fd4-b103-a00d3c53b2ff","Type":"ContainerStarted","Data":"ff279f2931635c0dc2e8b0c1bc825cd0c44bd85605b1d0f2f0115fdb8d157399"} Jul 03 19:10:42.682259 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.682239 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" event={"ID":"ecc3701f-7faf-4848-bb1f-09ff724650d0","Type":"ContainerStarted","Data":"21724b621485411cf3ad4d99fc4f2d3ff7d4b758eb3d4fe159ccb3f09eb54e42"} Jul 03 19:10:42.682357 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.682304 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" event={"ID":"ecc3701f-7faf-4848-bb1f-09ff724650d0","Type":"ContainerStarted","Data":"acca20e2bd463aa21938234785af931ffc9bd8037af4bc902d3ed9419c3e1187"} Jul 03 19:10:42.682357 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.682335 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" event={"ID":"ecc3701f-7faf-4848-bb1f-09ff724650d0","Type":"ContainerStarted","Data":"34f490759733b608b479c4bb9f35c46e21e5a5527de6a687dad989db1f01251b"} Jul 03 19:10:42.682438 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.682366 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" event={"ID":"ecc3701f-7faf-4848-bb1f-09ff724650d0","Type":"ContainerStarted","Data":"cb7b06ef136f9d12faaff484370100e037040538e6342531da00741747ed6bb2"} Jul 03 19:10:42.682438 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.682405 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" event={"ID":"ecc3701f-7faf-4848-bb1f-09ff724650d0","Type":"ContainerStarted","Data":"3d3ade8fb93f399931a8dd53309e88d98c4198ae33180ed1f3aa058b0b54755e"} Jul 03 19:10:42.682502 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.682445 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" event={"ID":"ecc3701f-7faf-4848-bb1f-09ff724650d0","Type":"ContainerStarted","Data":"f0fd8b17c83b948e52e74582e00adf91518ea78cd9bc144adb82c26e2f7dbcaf"} Jul 03 19:10:42.684733 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.684690 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lv8dm" podStartSLOduration=2.687257258 podStartE2EDuration="21.684674994s" totalImagesPullingTime="18.997417736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:42.684245951 +0000 UTC m=+22.831898246" watchObservedRunningTime="2026-07-03 19:10:42.684674994 +0000 UTC m=+22.832327254" Jul 03 19:10:42.699623 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.699583 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zcjbt" podStartSLOduration=2.817265087 podStartE2EDuration="21.699571769s" totalImagesPullingTime="18.882306682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:42.699195997 +0000 UTC m=+22.846848255" watchObservedRunningTime="2026-07-03 19:10:42.699571769 +0000 UTC m=+22.847224027" Jul 03 19:10:42.725904 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.725806 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cjbmx" podStartSLOduration=2.809328684 podStartE2EDuration="21.725784934s" totalImagesPullingTime="18.91645625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:42.725732594 +0000 UTC m=+22.873384852" watchObservedRunningTime="2026-07-03 19:10:42.725784934 +0000 UTC m=+22.873437200" Jul 03 19:10:42.741149 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.741104 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-snbdp" podStartSLOduration=2.894068748 podStartE2EDuration="21.741090325s" totalImagesPullingTime="18.847021577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:42.740672254 +0000 UTC m=+22.888324516" watchObservedRunningTime="2026-07-03 19:10:42.741090325 +0000 UTC m=+22.888742583" Jul 03 19:10:42.755018 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.754976 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-57.ec2.internal" podStartSLOduration=21.754963041 podStartE2EDuration="21.754963041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:42.754961933 +0000 UTC m=+22.902614212" watchObservedRunningTime="2026-07-03 19:10:42.754963041 +0000 UTC m=+22.902615299" Jul 03 19:10:42.804381 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.804327 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:42.876079 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:42.876049 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:43.439928 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.439897 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:43.440095 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:43.440008 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:43.440095 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.440069 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:43.440208 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:43.440186 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:43.685820 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.685768 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-phjvd" event={"ID":"21f24bca-f445-422b-a668-8ba349c814f0","Type":"ContainerStarted","Data":"202f2c7afa63d7b9994602bc0bee572ccb5a887b913f29777c7dbf9c68d056b2"} Jul 03 19:10:43.687543 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.687517 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" event={"ID":"b81e294d243496cfd6a8dce82cfccf39","Type":"ContainerStarted","Data":"675f3e08b32a6c976367b62c623b1234a7bc8d22fbe01d4078d04a7fbbfb967e"} Jul 03 19:10:43.688931 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.688901 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hdp8t" event={"ID":"dbb9f0b3-b16c-43e8-84a9-2d79872585fa","Type":"ContainerStarted","Data":"7f0770031b3181aaa34a1971ce3597318e4252c9b732053e99c269e95abc35b6"} Jul 03 19:10:43.690284 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.690233 2587 generic.go:356] "Generic (PLEG): container finished" podID="57a524e0-ad2c-406e-a6bf-1e2284235fc5" containerID="c63be3c7e402b16a6fdf76c7f70c35a7a91e940155465e2682674271c8af356c" exitCode=0 Jul 03 19:10:43.690371 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.690298 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" event={"ID":"57a524e0-ad2c-406e-a6bf-1e2284235fc5","Type":"ContainerDied","Data":"c63be3c7e402b16a6fdf76c7f70c35a7a91e940155465e2682674271c8af356c"} Jul 03 19:10:43.699089 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.699054 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-phjvd" podStartSLOduration=3.738989059 podStartE2EDuration="22.699039924s" totalImagesPullingTime="18.960050865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:43.69849406 +0000 UTC m=+23.846146318" watchObservedRunningTime="2026-07-03 19:10:43.699039924 +0000 UTC m=+23.846692182" Jul 03 19:10:43.735071 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.735027 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hdp8t" podStartSLOduration=2.330320648 podStartE2EDuration="22.735017116s" totalImagesPullingTime="20.404696468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-03 19:10:43.7117473 +0000 UTC m=+23.859399557" watchObservedRunningTime="2026-07-03 19:10:43.735017116 +0000 UTC m=+23.882669411" Jul 03 19:10:43.748788 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.748728 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-57.ec2.internal" podStartSLOduration=22.748715422 podStartE2EDuration="22.748715422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:43.748242838 +0000 UTC m=+23.895895097" watchObservedRunningTime="2026-07-03 19:10:43.748715422 +0000 UTC m=+23.896367680" Jul 03 19:10:43.815748 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.815723 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:43.915901 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.915878 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:43.939094 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:43.939051 2587 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 03 19:10:44.348045 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:44.347944 2587 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T19:10:43.939074737Z","UUID":"3b3ed86c-5bba-45f7-817f-71c058a43278","Handler":null,"Name":"","Endpoint":""} Jul 03 19:10:44.349433 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:44.349416 2587 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 03 19:10:44.349538 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:44.349449 2587 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 03 19:10:44.452419 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:44.452383 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:44.452578 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:44.452509 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:44.697748 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:44.697716 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" event={"ID":"ecc3701f-7faf-4848-bb1f-09ff724650d0","Type":"ContainerStarted","Data":"9468f0c88e9aa733eccc4f9bcdb17f7abcd2af8d1377127582bc84c63b3a950d"} Jul 03 19:10:44.700570 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:44.700541 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" event={"ID":"c830d1f0-68af-4eaf-aab8-ede043da7c02","Type":"ContainerStarted","Data":"1a21e393abc627b7404d9b675a9389ed5d2d2b07c85f6fd39bf8ad9b346f6762"} Jul 03 19:10:45.225967 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:45.225340 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cjbmx" Jul 03 19:10:45.439995 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:45.439964 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:45.440192 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:45.440005 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:45.440192 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:45.440108 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:45.440192 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:45.440129 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:45.705433 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:45.705399 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" event={"ID":"c830d1f0-68af-4eaf-aab8-ede043da7c02","Type":"ContainerStarted","Data":"fbdd1654f6849142c296a42b9712d55bcdfda743482b3b320847d13a09d1e7ca"} Jul 03 19:10:45.724495 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:45.723167 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-77cxp" podStartSLOduration=3.052221403 podStartE2EDuration="24.723145673s" totalImagesPullingTime="21.67092427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:45.721931757 +0000 UTC m=+25.869584014" watchObservedRunningTime="2026-07-03 19:10:45.723145673 +0000 UTC m=+25.870797933" Jul 03 19:10:46.439822 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:46.439791 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:46.439977 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:46.439897 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:47.273611 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:47.273385 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cjbmx" Jul 03 19:10:47.274061 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:47.273963 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cjbmx" Jul 03 19:10:47.440102 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:47.440062 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:47.440253 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:47.440199 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:47.440312 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:47.440255 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:47.440396 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:47.440375 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:47.714299 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:47.714257 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" event={"ID":"ecc3701f-7faf-4848-bb1f-09ff724650d0","Type":"ContainerStarted","Data":"8eb8bb47adf950834e6ae6b828ca578cd185ac9b1e84dda080429b8bbde9056c"} Jul 03 19:10:47.715116 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:47.715092 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cjbmx" Jul 03 19:10:47.738437 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:47.738386 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" podStartSLOduration=7.690356508 podStartE2EDuration="26.738370984s" totalImagesPullingTime="19.048014476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:47.737827848 +0000 UTC m=+27.885480152" watchObservedRunningTime="2026-07-03 19:10:47.738370984 +0000 UTC m=+27.886023246" Jul 03 19:10:47.793081 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:47.793043 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:48.440420 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:48.440344 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:48.441103 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:48.440510 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:48.716563 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:48.716491 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:48.716707 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:48.716573 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:48.717049 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:48.717033 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:48.731140 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:48.731119 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:48.734400 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:48.734379 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:10:49.027558 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:49.027338 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jkr57"] Jul 03 19:10:49.027798 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:49.027683 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:49.027857 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:49.027806 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:49.029205 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:49.029182 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lh4kg"] Jul 03 19:10:49.029320 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:49.029286 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:49.029394 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:49.029375 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:49.038459 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:49.038434 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dnsmw"] Jul 03 19:10:49.038568 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:49.038539 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:49.038634 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:49.038617 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:49.719874 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:49.719838 2587 generic.go:356] "Generic (PLEG): container finished" podID="57a524e0-ad2c-406e-a6bf-1e2284235fc5" containerID="498cefb71a7a51f186f76c6e3fd2b220360891aaf6faf0988e49117fb5005c0b" exitCode=0 Jul 03 19:10:49.720407 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:49.719917 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" event={"ID":"57a524e0-ad2c-406e-a6bf-1e2284235fc5","Type":"ContainerDied","Data":"498cefb71a7a51f186f76c6e3fd2b220360891aaf6faf0988e49117fb5005c0b"} Jul 03 19:10:50.439929 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:50.439898 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:50.440102 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:50.439898 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:50.440102 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:50.440022 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:50.440261 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:50.440138 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:50.725048 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:50.724973 2587 generic.go:356] "Generic (PLEG): container finished" podID="57a524e0-ad2c-406e-a6bf-1e2284235fc5" containerID="35fd3c79fce56bfea869efd4e8091686e1e41699d53dfb00d4fe8e54b710542b" exitCode=0 Jul 03 19:10:50.725406 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:50.725061 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" event={"ID":"57a524e0-ad2c-406e-a6bf-1e2284235fc5","Type":"ContainerDied","Data":"35fd3c79fce56bfea869efd4e8091686e1e41699d53dfb00d4fe8e54b710542b"} Jul 03 19:10:51.441435 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:51.441400 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:51.441591 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:51.441539 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:51.729038 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:51.729006 2587 generic.go:356] "Generic (PLEG): container finished" podID="57a524e0-ad2c-406e-a6bf-1e2284235fc5" containerID="45080d57250af02923e197ee40e59d2d7f0ebf005addccc330debb3f89b0c644" exitCode=0 Jul 03 19:10:51.729453 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:51.729048 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" event={"ID":"57a524e0-ad2c-406e-a6bf-1e2284235fc5","Type":"ContainerDied","Data":"45080d57250af02923e197ee40e59d2d7f0ebf005addccc330debb3f89b0c644"} Jul 03 19:10:52.439652 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:52.439611 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:52.439834 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:52.439672 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:52.439834 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:52.439754 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:52.439923 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:52.439883 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:53.439750 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:53.439720 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:53.440073 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:53.439852 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:53.992047 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:53.992009 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:53.992224 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:53.992095 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:53.992224 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:53.992192 2587 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:53.992346 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:53.992220 2587 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:53.992346 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:53.992274 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret podName:e8d28707-c79a-489a-aef0-b389707b64c1 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:25.992254412 +0000 UTC m=+66.139906667 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret") pod "global-pull-secret-syncer-lh4kg" (UID: "e8d28707-c79a-489a-aef0-b389707b64c1") : object "kube-system"/"original-pull-secret" not registered Jul 03 19:10:53.992346 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:53.992297 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs podName:003930ac-166e-4958-b6e8-30444b6e6fec nodeName:}" failed. No retries permitted until 2026-07-03 19:11:25.992286152 +0000 UTC m=+66.139938394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs") pod "network-metrics-daemon-dnsmw" (UID: "003930ac-166e-4958-b6e8-30444b6e6fec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 19:10:54.092580 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:54.092549 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn62s\" (UniqueName: \"kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s\") pod \"network-check-target-jkr57\" (UID: \"9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8\") " pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:54.092744 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:54.092706 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 19:10:54.092744 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:54.092726 2587 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 19:10:54.092744 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:54.092736 2587 projected.go:196] Error preparing data for projected volume kube-api-access-kn62s for pod openshift-network-diagnostics/network-check-target-jkr57: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:54.092854 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:54.092803 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s podName:9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:26.092788664 +0000 UTC m=+66.240440916 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kn62s" (UniqueName: "kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s") pod "network-check-target-jkr57" (UID: "9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 19:10:54.222053 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:54.222023 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:54.279953 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:54.279874 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:54.369108 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:54.369070 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:54.425876 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:54.425841 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:54.439725 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:54.439700 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:54.439725 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:54.439716 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:54.440267 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:54.439836 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lh4kg" podUID="e8d28707-c79a-489a-aef0-b389707b64c1" Jul 03 19:10:54.440267 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:54.439973 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkr57" podUID="9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8" Jul 03 19:10:54.487677 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:54.487646 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:55.440346 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.440276 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:55.440884 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:55.440407 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnsmw" podUID="003930ac-166e-4958-b6e8-30444b6e6fec" Jul 03 19:10:55.638866 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.638836 2587 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-57.ec2.internal" event="NodeReady" Jul 03 19:10:55.639056 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.638992 2587 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 03 19:10:55.686333 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.686289 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m826r"] Jul 03 19:10:55.719237 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.719154 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bgdfp"] Jul 03 19:10:55.719385 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.719284 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m826r" Jul 03 19:10:55.721653 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.721630 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 03 19:10:55.721653 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.721648 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8lvgc\"" Jul 03 19:10:55.721852 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.721630 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 03 19:10:55.732058 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.732029 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m826r"] Jul 03 19:10:55.732145 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.732077 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bgdfp"] Jul 03 19:10:55.732197 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.732142 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bgdfp" Jul 03 19:10:55.736044 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.735236 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 03 19:10:55.736044 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.735556 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 03 19:10:55.736044 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.735874 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 03 19:10:55.736044 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.735880 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ghd46\"" Jul 03 19:10:55.803660 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.803623 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4xfc\" (UniqueName: \"kubernetes.io/projected/75adf88a-862f-446c-82a5-8bbd5992149d-kube-api-access-x4xfc\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:55.803868 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.803671 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75adf88a-862f-446c-82a5-8bbd5992149d-tmp-dir\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:55.803868 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.803792 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:55.803868 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.803835 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75adf88a-862f-446c-82a5-8bbd5992149d-config-volume\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:55.904992 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.904955 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:55.904992 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.905000 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75adf88a-862f-446c-82a5-8bbd5992149d-config-volume\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:55.905235 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.905031 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntcf5\" (UniqueName: \"kubernetes.io/projected/96797db3-4d01-49be-9671-7e2d755f70db-kube-api-access-ntcf5\") pod \"ingress-canary-bgdfp\" (UID: \"96797db3-4d01-49be-9671-7e2d755f70db\") " pod="openshift-ingress-canary/ingress-canary-bgdfp" Jul 03 19:10:55.905235 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.905069 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96797db3-4d01-49be-9671-7e2d755f70db-cert\") pod \"ingress-canary-bgdfp\" (UID: \"96797db3-4d01-49be-9671-7e2d755f70db\") " pod="openshift-ingress-canary/ingress-canary-bgdfp" Jul 03 19:10:55.905235 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.905105 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4xfc\" (UniqueName: \"kubernetes.io/projected/75adf88a-862f-446c-82a5-8bbd5992149d-kube-api-access-x4xfc\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:55.905235 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:55.905122 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:55.905235 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:55.905199 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls podName:75adf88a-862f-446c-82a5-8bbd5992149d nodeName:}" failed. No retries permitted until 2026-07-03 19:10:56.40517695 +0000 UTC m=+36.552829187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls") pod "dns-default-m826r" (UID: "75adf88a-862f-446c-82a5-8bbd5992149d") : secret "dns-default-metrics-tls" not found Jul 03 19:10:55.905235 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.905221 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75adf88a-862f-446c-82a5-8bbd5992149d-tmp-dir\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:55.905540 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.905514 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75adf88a-862f-446c-82a5-8bbd5992149d-tmp-dir\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:55.905641 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.905619 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/75adf88a-862f-446c-82a5-8bbd5992149d-config-volume\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:55.915440 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:55.915285 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4xfc\" (UniqueName: \"kubernetes.io/projected/75adf88a-862f-446c-82a5-8bbd5992149d-kube-api-access-x4xfc\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:56.005964 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.005880 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntcf5\" (UniqueName: \"kubernetes.io/projected/96797db3-4d01-49be-9671-7e2d755f70db-kube-api-access-ntcf5\") pod \"ingress-canary-bgdfp\" (UID: \"96797db3-4d01-49be-9671-7e2d755f70db\") " pod="openshift-ingress-canary/ingress-canary-bgdfp" Jul 03 19:10:56.005964 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.005941 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96797db3-4d01-49be-9671-7e2d755f70db-cert\") pod \"ingress-canary-bgdfp\" (UID: \"96797db3-4d01-49be-9671-7e2d755f70db\") " pod="openshift-ingress-canary/ingress-canary-bgdfp" Jul 03 19:10:56.009156 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.009130 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96797db3-4d01-49be-9671-7e2d755f70db-cert\") pod \"ingress-canary-bgdfp\" (UID: \"96797db3-4d01-49be-9671-7e2d755f70db\") " pod="openshift-ingress-canary/ingress-canary-bgdfp" Jul 03 19:10:56.014365 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.014338 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntcf5\" (UniqueName: \"kubernetes.io/projected/96797db3-4d01-49be-9671-7e2d755f70db-kube-api-access-ntcf5\") pod \"ingress-canary-bgdfp\" (UID: \"96797db3-4d01-49be-9671-7e2d755f70db\") " pod="openshift-ingress-canary/ingress-canary-bgdfp" Jul 03 19:10:56.044407 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.044372 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bgdfp" Jul 03 19:10:56.407338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.407311 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bgdfp"] Jul 03 19:10:56.408985 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.408965 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:56.409134 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:56.409116 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:56.409189 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:56.409179 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls podName:75adf88a-862f-446c-82a5-8bbd5992149d nodeName:}" failed. No retries permitted until 2026-07-03 19:10:57.409164506 +0000 UTC m=+37.556816745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls") pod "dns-default-m826r" (UID: "75adf88a-862f-446c-82a5-8bbd5992149d") : secret "dns-default-metrics-tls" not found Jul 03 19:10:56.439714 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.439679 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:10:56.439892 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.439679 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:10:56.442513 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.442491 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 19:10:56.442924 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.442521 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 19:10:56.442924 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.442546 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 19:10:56.442924 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.442679 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g8gc2\"" Jul 03 19:10:56.509121 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:10:56.509086 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96797db3_4d01_49be_9671_7e2d755f70db.slice/crio-515f295efcd6e953aa1fb3f468b14a337d4757c8f792dc38ab10c089d8bb2135 WatchSource:0}: Error finding container 515f295efcd6e953aa1fb3f468b14a337d4757c8f792dc38ab10c089d8bb2135: Status 404 returned error can't find the container with id 515f295efcd6e953aa1fb3f468b14a337d4757c8f792dc38ab10c089d8bb2135 Jul 03 19:10:56.744456 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.744424 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" event={"ID":"57a524e0-ad2c-406e-a6bf-1e2284235fc5","Type":"ContainerStarted","Data":"e425a745de273a3e1b357d8d29cba90956dbf769b9ae679a2f9c07ee0f9f1c73"} Jul 03 19:10:56.745622 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:56.745596 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bgdfp" event={"ID":"96797db3-4d01-49be-9671-7e2d755f70db","Type":"ContainerStarted","Data":"515f295efcd6e953aa1fb3f468b14a337d4757c8f792dc38ab10c089d8bb2135"} Jul 03 19:10:57.417793 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:57.417745 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:57.417969 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:57.417906 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:57.418027 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:57.417988 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls podName:75adf88a-862f-446c-82a5-8bbd5992149d nodeName:}" failed. No retries permitted until 2026-07-03 19:10:59.417968312 +0000 UTC m=+39.565620551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls") pod "dns-default-m826r" (UID: "75adf88a-862f-446c-82a5-8bbd5992149d") : secret "dns-default-metrics-tls" not found Jul 03 19:10:57.444000 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:57.443976 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:10:57.446276 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:57.446250 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 19:10:57.446404 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:57.446369 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wwb25\"" Jul 03 19:10:57.751675 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:57.751595 2587 generic.go:356] "Generic (PLEG): container finished" podID="57a524e0-ad2c-406e-a6bf-1e2284235fc5" containerID="e425a745de273a3e1b357d8d29cba90956dbf769b9ae679a2f9c07ee0f9f1c73" exitCode=0 Jul 03 19:10:57.751675 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:57.751652 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" event={"ID":"57a524e0-ad2c-406e-a6bf-1e2284235fc5","Type":"ContainerDied","Data":"e425a745de273a3e1b357d8d29cba90956dbf769b9ae679a2f9c07ee0f9f1c73"} Jul 03 19:10:58.758561 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:58.758467 2587 generic.go:356] "Generic (PLEG): container finished" podID="57a524e0-ad2c-406e-a6bf-1e2284235fc5" containerID="8a2fd7767ab2f1c10e00a2a9fcc81ceedc2649e6fd34950f8d9725952cd38d3d" exitCode=0 Jul 03 19:10:58.758561 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:58.758529 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" event={"ID":"57a524e0-ad2c-406e-a6bf-1e2284235fc5","Type":"ContainerDied","Data":"8a2fd7767ab2f1c10e00a2a9fcc81ceedc2649e6fd34950f8d9725952cd38d3d"} Jul 03 19:10:59.431190 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:59.431015 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:10:59.431368 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:59.431190 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:10:59.431368 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:10:59.431273 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls podName:75adf88a-862f-446c-82a5-8bbd5992149d nodeName:}" failed. No retries permitted until 2026-07-03 19:11:03.43124905 +0000 UTC m=+43.578901307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls") pod "dns-default-m826r" (UID: "75adf88a-862f-446c-82a5-8bbd5992149d") : secret "dns-default-metrics-tls" not found Jul 03 19:10:59.731599 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:59.731568 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:59.763698 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:59.763669 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" event={"ID":"57a524e0-ad2c-406e-a6bf-1e2284235fc5","Type":"ContainerStarted","Data":"34ff9f0fa8f24b52b7f8f12ddb19c3dd33e6c537e11be202f575575ca91ad641"} Jul 03 19:10:59.765102 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:59.765077 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bgdfp" event={"ID":"96797db3-4d01-49be-9671-7e2d755f70db","Type":"ContainerStarted","Data":"3db310403b32ea55ac798a3b52c1efa447cb635aa5109bece3e2d7c379522137"} Jul 03 19:10:59.783735 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:59.783706 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:59.784115 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:59.784067 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9mxvx" podStartSLOduration=8.472188948 podStartE2EDuration="38.784052766s" totalImagesPullingTime="30.311863818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:59.782867721 +0000 UTC m=+39.930519998" watchObservedRunningTime="2026-07-03 19:10:59.784052766 +0000 UTC m=+39.931705023" Jul 03 19:10:59.801343 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:59.801297 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bgdfp" podStartSLOduration=2.069063546 podStartE2EDuration="4.801284763s" totalImagesPullingTime="2.732221217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:10:59.800708749 +0000 UTC m=+39.948361007" watchObservedRunningTime="2026-07-03 19:10:59.801284763 +0000 UTC m=+39.948937043" Jul 03 19:10:59.877284 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:59.877249 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:10:59.931248 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:10:59.931218 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:01.847155 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:01.847116 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:01.895094 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:01.895064 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:03.461894 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:03.461864 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:11:03.462271 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:03.461961 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:11:03.462271 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:03.462010 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls podName:75adf88a-862f-446c-82a5-8bbd5992149d nodeName:}" failed. No retries permitted until 2026-07-03 19:11:11.461995907 +0000 UTC m=+51.609648142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls") pod "dns-default-m826r" (UID: "75adf88a-862f-446c-82a5-8bbd5992149d") : secret "dns-default-metrics-tls" not found Jul 03 19:11:05.530458 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.530427 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp"] Jul 03 19:11:05.572621 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.572586 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s"] Jul 03 19:11:05.573943 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.572940 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" Jul 03 19:11:05.576707 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.576681 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 03 19:11:05.576707 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.576700 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:11:05.576707 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.576705 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 03 19:11:05.576920 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.576849 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-q6jkn\"" Jul 03 19:11:05.577493 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.577470 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 03 19:11:05.593589 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.593565 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp"] Jul 03 19:11:05.593589 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.593593 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s"] Jul 03 19:11:05.593723 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.593658 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" Jul 03 19:11:05.596077 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.596056 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 03 19:11:05.596077 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.596071 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 03 19:11:05.596241 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.596103 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-299td\"" Jul 03 19:11:05.596241 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.596200 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:11:05.596457 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.596442 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 03 19:11:05.631873 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.631840 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns"] Jul 03 19:11:05.658868 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.658846 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns"] Jul 03 19:11:05.659023 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.658955 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:05.661312 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.661269 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 03 19:11:05.661429 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.661358 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 03 19:11:05.661429 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.661358 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 03 19:11:05.662117 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.662101 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jkf85\"" Jul 03 19:11:05.662224 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.662146 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 03 19:11:05.674887 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.674868 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d-config\") pod \"service-ca-operator-5d46d9ffd4-llvcp\" (UID: \"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" Jul 03 19:11:05.674988 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.674926 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjd64\" (UniqueName: \"kubernetes.io/projected/e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d-kube-api-access-fjd64\") pod \"service-ca-operator-5d46d9ffd4-llvcp\" (UID: \"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" Jul 03 19:11:05.674988 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.674965 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-llvcp\" (UID: \"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" Jul 03 19:11:05.755687 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.755660 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6686459f4f-rcb5g"] Jul 03 19:11:05.776097 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.776071 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dwtl\" (UniqueName: \"kubernetes.io/projected/0c792b24-59a4-4c99-b77b-c3709eba2bea-kube-api-access-8dwtl\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:05.776243 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.776119 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d-config\") pod \"service-ca-operator-5d46d9ffd4-llvcp\" (UID: \"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" Jul 03 19:11:05.776243 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.776142 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0c792b24-59a4-4c99-b77b-c3709eba2bea-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:05.776330 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.776252 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3adc0527-678e-4d7e-9f59-01913ab54679-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-85l4s\" (UID: \"3adc0527-678e-4d7e-9f59-01913ab54679\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" Jul 03 19:11:05.776330 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.776279 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:05.776330 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.776327 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjd64\" (UniqueName: \"kubernetes.io/projected/e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d-kube-api-access-fjd64\") pod \"service-ca-operator-5d46d9ffd4-llvcp\" (UID: \"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" Jul 03 19:11:05.776462 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.776349 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6dwp\" (UniqueName: \"kubernetes.io/projected/3adc0527-678e-4d7e-9f59-01913ab54679-kube-api-access-g6dwp\") pod \"kube-storage-version-migrator-operator-846bf668f7-85l4s\" (UID: \"3adc0527-678e-4d7e-9f59-01913ab54679\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" Jul 03 19:11:05.776462 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.776378 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-llvcp\" (UID: \"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" Jul 03 19:11:05.776462 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.776405 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3adc0527-678e-4d7e-9f59-01913ab54679-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-85l4s\" (UID: \"3adc0527-678e-4d7e-9f59-01913ab54679\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" Jul 03 19:11:05.776711 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.776688 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d-config\") pod \"service-ca-operator-5d46d9ffd4-llvcp\" (UID: \"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" Jul 03 19:11:05.779629 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.779612 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-llvcp\" (UID: \"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" Jul 03 19:11:05.780876 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.780836 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6686459f4f-rcb5g"] Jul 03 19:11:05.780946 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.780918 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.783051 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.783032 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 03 19:11:05.783152 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.783035 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 03 19:11:05.783207 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.783173 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 03 19:11:05.783411 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.783394 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4z568\"" Jul 03 19:11:05.787754 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.787726 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjd64\" (UniqueName: \"kubernetes.io/projected/e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d-kube-api-access-fjd64\") pod \"service-ca-operator-5d46d9ffd4-llvcp\" (UID: \"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" Jul 03 19:11:05.788840 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.788815 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 03 19:11:05.876163 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.876129 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:05.877162 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877139 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6dwp\" (UniqueName: \"kubernetes.io/projected/3adc0527-678e-4d7e-9f59-01913ab54679-kube-api-access-g6dwp\") pod \"kube-storage-version-migrator-operator-846bf668f7-85l4s\" (UID: \"3adc0527-678e-4d7e-9f59-01913ab54679\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" Jul 03 19:11:05.877221 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877173 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3adc0527-678e-4d7e-9f59-01913ab54679-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-85l4s\" (UID: \"3adc0527-678e-4d7e-9f59-01913ab54679\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" Jul 03 19:11:05.877221 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877198 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-installation-pull-secrets\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.877361 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877339 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dwtl\" (UniqueName: \"kubernetes.io/projected/0c792b24-59a4-4c99-b77b-c3709eba2bea-kube-api-access-8dwtl\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:05.877417 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877393 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0c792b24-59a4-4c99-b77b-c3709eba2bea-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:05.877469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877423 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3adc0527-678e-4d7e-9f59-01913ab54679-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-85l4s\" (UID: \"3adc0527-678e-4d7e-9f59-01913ab54679\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" Jul 03 19:11:05.877469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877441 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:05.877469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877459 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-trusted-ca\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.877614 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:05.877540 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 03 19:11:05.877614 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877587 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-bound-sa-token\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.877694 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:05.877631 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls podName:0c792b24-59a4-4c99-b77b-c3709eba2bea nodeName:}" failed. No retries permitted until 2026-07-03 19:11:06.377605351 +0000 UTC m=+46.525257587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pj7ns" (UID: "0c792b24-59a4-4c99-b77b-c3709eba2bea") : secret "cluster-monitoring-operator-tls" not found Jul 03 19:11:05.877694 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877669 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-certificates\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.877876 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877715 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwxr6\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-kube-api-access-cwxr6\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.877876 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877747 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.877876 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877813 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-image-registry-private-configuration\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.877876 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.877848 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-ca-trust-extracted\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.878032 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.878014 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3adc0527-678e-4d7e-9f59-01913ab54679-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-85l4s\" (UID: \"3adc0527-678e-4d7e-9f59-01913ab54679\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" Jul 03 19:11:05.878174 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.878159 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0c792b24-59a4-4c99-b77b-c3709eba2bea-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:05.879459 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.879440 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3adc0527-678e-4d7e-9f59-01913ab54679-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-85l4s\" (UID: \"3adc0527-678e-4d7e-9f59-01913ab54679\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" Jul 03 19:11:05.882750 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.882726 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" Jul 03 19:11:05.885194 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.885172 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6dwp\" (UniqueName: \"kubernetes.io/projected/3adc0527-678e-4d7e-9f59-01913ab54679-kube-api-access-g6dwp\") pod \"kube-storage-version-migrator-operator-846bf668f7-85l4s\" (UID: \"3adc0527-678e-4d7e-9f59-01913ab54679\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" Jul 03 19:11:05.885277 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.885177 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dwtl\" (UniqueName: \"kubernetes.io/projected/0c792b24-59a4-4c99-b77b-c3709eba2bea-kube-api-access-8dwtl\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:05.901068 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.901045 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" Jul 03 19:11:05.934309 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.934286 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.978546 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-trusted-ca\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.978590 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-bound-sa-token\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.978619 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-certificates\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.978661 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwxr6\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-kube-api-access-cwxr6\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.978692 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.978737 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-image-registry-private-configuration\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.978789 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-ca-trust-extracted\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.978834 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-installation-pull-secrets\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:05.979083 2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:05.979105 2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6686459f4f-rcb5g: secret "image-registry-tls" not found Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:05.979164 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls podName:e7e1b673-c2d8-4f75-b7c2-ee368adc05bf nodeName:}" failed. No retries permitted until 2026-07-03 19:11:06.479144405 +0000 UTC m=+46.626796667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls") pod "image-registry-6686459f4f-rcb5g" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf") : secret "image-registry-tls" not found Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.979631 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-ca-trust-extracted\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.979896 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.979787 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-trusted-ca\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.980639 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.979956 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-certificates\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.983620 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.983131 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-installation-pull-secrets\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.984817 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.984600 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-image-registry-private-configuration\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.986827 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.986783 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-bound-sa-token\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:05.987930 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:05.987914 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwxr6\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-kube-api-access-cwxr6\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:06.050223 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:06.050186 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b3c431_df9f_4c7e_b96b_fa0e27ddfe3d.slice/crio-0fff716f76041a5f4e9e070927402a117cff04c57a8ca47c3dc92103466a438b WatchSource:0}: Error finding container 0fff716f76041a5f4e9e070927402a117cff04c57a8ca47c3dc92103466a438b: Status 404 returned error can't find the container with id 0fff716f76041a5f4e9e070927402a117cff04c57a8ca47c3dc92103466a438b Jul 03 19:11:06.055883 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:06.055752 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp"] Jul 03 19:11:06.084179 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:06.084143 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s"] Jul 03 19:11:06.087694 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:06.087669 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adc0527_678e_4d7e_9f59_01913ab54679.slice/crio-6ef00c4695a15c1d43e4b8851968d0bfe4977508139781f2547e4132c7572495 WatchSource:0}: Error finding container 6ef00c4695a15c1d43e4b8851968d0bfe4977508139781f2547e4132c7572495: Status 404 returned error can't find the container with id 6ef00c4695a15c1d43e4b8851968d0bfe4977508139781f2547e4132c7572495 Jul 03 19:11:06.381390 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:06.381358 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:06.381553 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:06.381504 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 03 19:11:06.381598 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:06.381566 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls podName:0c792b24-59a4-4c99-b77b-c3709eba2bea nodeName:}" failed. No retries permitted until 2026-07-03 19:11:07.381551157 +0000 UTC m=+47.529203393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pj7ns" (UID: "0c792b24-59a4-4c99-b77b-c3709eba2bea") : secret "cluster-monitoring-operator-tls" not found Jul 03 19:11:06.482099 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:06.482062 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:06.482257 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:06.482221 2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 19:11:06.482257 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:06.482238 2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6686459f4f-rcb5g: secret "image-registry-tls" not found Jul 03 19:11:06.482325 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:06.482291 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls podName:e7e1b673-c2d8-4f75-b7c2-ee368adc05bf nodeName:}" failed. No retries permitted until 2026-07-03 19:11:07.482276339 +0000 UTC m=+47.629928576 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls") pod "image-registry-6686459f4f-rcb5g" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf") : secret "image-registry-tls" not found Jul 03 19:11:06.786128 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:06.786043 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" event={"ID":"3adc0527-678e-4d7e-9f59-01913ab54679","Type":"ContainerStarted","Data":"6ef00c4695a15c1d43e4b8851968d0bfe4977508139781f2547e4132c7572495"} Jul 03 19:11:06.787515 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:06.787481 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" event={"ID":"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d","Type":"ContainerStarted","Data":"0fff716f76041a5f4e9e070927402a117cff04c57a8ca47c3dc92103466a438b"} Jul 03 19:11:07.389055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:07.389019 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:07.389264 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:07.389209 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 03 19:11:07.389320 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:07.389284 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls podName:0c792b24-59a4-4c99-b77b-c3709eba2bea nodeName:}" failed. No retries permitted until 2026-07-03 19:11:09.389265564 +0000 UTC m=+49.536917799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pj7ns" (UID: "0c792b24-59a4-4c99-b77b-c3709eba2bea") : secret "cluster-monitoring-operator-tls" not found Jul 03 19:11:07.490157 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:07.490120 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:07.490308 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:07.490270 2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 19:11:07.490308 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:07.490291 2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6686459f4f-rcb5g: secret "image-registry-tls" not found Jul 03 19:11:07.490406 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:07.490360 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls podName:e7e1b673-c2d8-4f75-b7c2-ee368adc05bf nodeName:}" failed. No retries permitted until 2026-07-03 19:11:09.490337728 +0000 UTC m=+49.637989964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls") pod "image-registry-6686459f4f-rcb5g" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf") : secret "image-registry-tls" not found Jul 03 19:11:08.406325 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:08.406291 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:08.511872 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:08.511835 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:09.404330 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:09.404294 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:09.404524 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:09.404455 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 03 19:11:09.404524 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:09.404522 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls podName:0c792b24-59a4-4c99-b77b-c3709eba2bea nodeName:}" failed. No retries permitted until 2026-07-03 19:11:13.404503283 +0000 UTC m=+53.552155536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pj7ns" (UID: "0c792b24-59a4-4c99-b77b-c3709eba2bea") : secret "cluster-monitoring-operator-tls" not found Jul 03 19:11:09.504936 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:09.504889 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:09.505306 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:09.505050 2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 19:11:09.505306 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:09.505068 2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6686459f4f-rcb5g: secret "image-registry-tls" not found Jul 03 19:11:09.505306 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:09.505125 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls podName:e7e1b673-c2d8-4f75-b7c2-ee368adc05bf nodeName:}" failed. No retries permitted until 2026-07-03 19:11:13.50510895 +0000 UTC m=+53.652761205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls") pod "image-registry-6686459f4f-rcb5g" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf") : secret "image-registry-tls" not found Jul 03 19:11:09.796944 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:09.796904 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" event={"ID":"3adc0527-678e-4d7e-9f59-01913ab54679","Type":"ContainerStarted","Data":"278b0c366e5d3bf0427146178ca0df168e2ca6eab8c7ed8725dd936ed5db7956"} Jul 03 19:11:09.798361 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:09.798334 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" event={"ID":"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d","Type":"ContainerStarted","Data":"89474c2d52a9d55a9f0b834646b60d0814a30ba42e060d7b1d4b9813384800a1"} Jul 03 19:11:09.812133 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:09.812088 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" podStartSLOduration=1.634680618 podStartE2EDuration="4.812071737s" totalImagesPullingTime="3.177391119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:09.811143322 +0000 UTC m=+49.958795600" watchObservedRunningTime="2026-07-03 19:11:09.812071737 +0000 UTC m=+49.959723997" Jul 03 19:11:09.827033 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:09.826979 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" podStartSLOduration=1.606170425 podStartE2EDuration="4.826958953s" totalImagesPullingTime="3.220788528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:09.825267113 +0000 UTC m=+49.972919372" watchObservedRunningTime="2026-07-03 19:11:09.826958953 +0000 UTC m=+49.974611192" Jul 03 19:11:10.070233 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.070153 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6gq4v"] Jul 03 19:11:10.081908 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.081884 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.084489 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.084306 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 03 19:11:10.084489 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.084324 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 03 19:11:10.084489 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.084447 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6gq4v"] Jul 03 19:11:10.084754 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.084605 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 03 19:11:10.084754 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.084705 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lkngf\"" Jul 03 19:11:10.085127 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.085110 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 03 19:11:10.090733 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.090699 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:10.109501 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.109477 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-crio-socket\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.109616 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.109504 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.109616 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.109530 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.109692 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.109649 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gvw8\" (UniqueName: \"kubernetes.io/projected/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-api-access-5gvw8\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.109735 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.109694 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-data-volume\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.146480 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.146442 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:10.210819 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.210762 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.210990 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.210883 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gvw8\" (UniqueName: \"kubernetes.io/projected/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-api-access-5gvw8\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.210990 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.210925 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-data-volume\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.210990 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:10.210981 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:10.211145 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.211022 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-crio-socket\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.211145 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:10.211054 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls podName:79fccd49-ac9b-4b7d-be42-f7c7b7a69e08 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:10.711036941 +0000 UTC m=+50.858689199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gq4v" (UID: "79fccd49-ac9b-4b7d-be42-f7c7b7a69e08") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:10.211145 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.211071 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.211145 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:10.211135 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:10.211335 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:10.211172 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm podName:79fccd49-ac9b-4b7d-be42-f7c7b7a69e08 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:10.711162387 +0000 UTC m=+50.858814637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gq4v" (UID: "79fccd49-ac9b-4b7d-be42-f7c7b7a69e08") : configmap "kube-rbac-proxy" not found Jul 03 19:11:10.211335 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.211210 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-crio-socket\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.211548 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.211527 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-data-volume\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.220789 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.220748 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gvw8\" (UniqueName: \"kubernetes.io/projected/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-api-access-5gvw8\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.351532 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.351452 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:10.401383 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.401350 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:10.548381 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.548354 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:10.617250 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.617178 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:10.670532 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.670498 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:10.716028 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.715996 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.716028 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.716031 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:10.716212 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:10.716126 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:10.716212 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:10.716195 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm podName:79fccd49-ac9b-4b7d-be42-f7c7b7a69e08 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:11.716181567 +0000 UTC m=+51.863833806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gq4v" (UID: "79fccd49-ac9b-4b7d-be42-f7c7b7a69e08") : configmap "kube-rbac-proxy" not found Jul 03 19:11:10.716339 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:10.716225 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:10.716339 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:10.716297 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls podName:79fccd49-ac9b-4b7d-be42-f7c7b7a69e08 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:11.716284796 +0000 UTC m=+51.863937031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gq4v" (UID: "79fccd49-ac9b-4b7d-be42-f7c7b7a69e08") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:10.786765 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.786734 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:10.841540 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:10.841509 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:11.059344 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:11.059320 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:11.159247 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:11.159218 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:11.522993 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:11.522922 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:11:11.523147 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:11.523042 2587 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 03 19:11:11.523147 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:11.523092 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls podName:75adf88a-862f-446c-82a5-8bbd5992149d nodeName:}" failed. No retries permitted until 2026-07-03 19:11:27.523079172 +0000 UTC m=+67.670731408 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls") pod "dns-default-m826r" (UID: "75adf88a-862f-446c-82a5-8bbd5992149d") : secret "dns-default-metrics-tls" not found Jul 03 19:11:11.724520 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:11.724486 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:11.724520 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:11.724525 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:11.725011 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:11.724609 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:11.725011 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:11.724620 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:11.725011 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:11.724672 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls podName:79fccd49-ac9b-4b7d-be42-f7c7b7a69e08 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:13.724660007 +0000 UTC m=+53.872312242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gq4v" (UID: "79fccd49-ac9b-4b7d-be42-f7c7b7a69e08") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:11.725011 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:11.724685 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm podName:79fccd49-ac9b-4b7d-be42-f7c7b7a69e08 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:13.724678874 +0000 UTC m=+53.872331109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gq4v" (UID: "79fccd49-ac9b-4b7d-be42-f7c7b7a69e08") : configmap "kube-rbac-proxy" not found Jul 03 19:11:12.241919 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:12.241895 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-snbdp_eb073b99-db12-43df-b79c-f1ae057356cf/dns-node-resolver/0.log" Jul 03 19:11:12.692677 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:12.692643 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:12.744258 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:12.744229 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:13.042206 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:13.042127 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hdp8t_dbb9f0b3-b16c-43e8-84a9-2d79872585fa/node-ca/0.log" Jul 03 19:11:13.439154 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:13.439115 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:13.439401 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:13.439264 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 03 19:11:13.439401 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:13.439335 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls podName:0c792b24-59a4-4c99-b77b-c3709eba2bea nodeName:}" failed. No retries permitted until 2026-07-03 19:11:21.439320612 +0000 UTC m=+61.586972848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pj7ns" (UID: "0c792b24-59a4-4c99-b77b-c3709eba2bea") : secret "cluster-monitoring-operator-tls" not found Jul 03 19:11:13.529900 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:13.529870 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:13.540080 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:13.540052 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:13.540207 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:13.540191 2587 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 03 19:11:13.540207 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:13.540208 2587 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6686459f4f-rcb5g: secret "image-registry-tls" not found Jul 03 19:11:13.540291 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:13.540262 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls podName:e7e1b673-c2d8-4f75-b7c2-ee368adc05bf nodeName:}" failed. No retries permitted until 2026-07-03 19:11:21.540248876 +0000 UTC m=+61.687901112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls") pod "image-registry-6686459f4f-rcb5g" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf") : secret "image-registry-tls" not found Jul 03 19:11:13.642313 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:13.642285 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bgdfp_96797db3-4d01-49be-9671-7e2d755f70db/serve-healthcheck-canary/0.log" Jul 03 19:11:13.741843 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:13.741735 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:13.741843 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:13.741789 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:13.742045 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:13.741873 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:13.742045 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:13.741916 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:13.742045 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:13.741943 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm podName:79fccd49-ac9b-4b7d-be42-f7c7b7a69e08 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:17.741923885 +0000 UTC m=+57.889576140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gq4v" (UID: "79fccd49-ac9b-4b7d-be42-f7c7b7a69e08") : configmap "kube-rbac-proxy" not found Jul 03 19:11:13.742045 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:13.741961 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls podName:79fccd49-ac9b-4b7d-be42-f7c7b7a69e08 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:17.741952466 +0000 UTC m=+57.889604702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gq4v" (UID: "79fccd49-ac9b-4b7d-be42-f7c7b7a69e08") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:16.596960 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:16.596932 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:16.644425 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:16.644390 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:16.804279 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:16.804244 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:16.905158 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:16.905083 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:17.008946 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:17.008913 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:17.500874 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:17.500846 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:17.775304 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:17.775220 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:17.775304 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:17.775271 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:17.775708 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:17.775337 2587 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 03 19:11:17.775708 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:17.775361 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:17.775708 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:17.775420 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls podName:79fccd49-ac9b-4b7d-be42-f7c7b7a69e08 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:25.775398791 +0000 UTC m=+65.923051031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gq4v" (UID: "79fccd49-ac9b-4b7d-be42-f7c7b7a69e08") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:17.775708 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:17.775446 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm podName:79fccd49-ac9b-4b7d-be42-f7c7b7a69e08 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:25.775435724 +0000 UTC m=+65.923087963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6gq4v" (UID: "79fccd49-ac9b-4b7d-be42-f7c7b7a69e08") : configmap "kube-rbac-proxy" not found Jul 03 19:11:18.286396 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:18.286368 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:18.683350 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:18.683321 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:18.887835 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:18.887802 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:19.088576 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:19.088538 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:19.291481 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:19.291451 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:19.934393 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:19.934360 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:20.036876 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:20.036841 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:20.136150 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:20.136117 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:20.284176 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:20.284086 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:20.691347 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:20.691315 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:20.735381 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:20.735360 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvdx5" Jul 03 19:11:20.886062 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:20.886035 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:20.937936 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:20.937909 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:21.087651 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:21.087621 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:21.495356 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:21.495272 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:21.508462 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:21.508438 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:21.508593 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:21.508577 2587 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 03 19:11:21.508655 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:21.508645 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls podName:0c792b24-59a4-4c99-b77b-c3709eba2bea nodeName:}" failed. No retries permitted until 2026-07-03 19:11:37.508622889 +0000 UTC m=+77.656275125 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-pj7ns" (UID: "0c792b24-59a4-4c99-b77b-c3709eba2bea") : secret "cluster-monitoring-operator-tls" not found Jul 03 19:11:21.609330 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:21.609294 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:21.611783 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:21.611739 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls\") pod \"image-registry-6686459f4f-rcb5g\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:21.699379 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:21.699348 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4z568\"" Jul 03 19:11:21.708112 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:21.708087 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:21.831533 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:21.831499 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6686459f4f-rcb5g"] Jul 03 19:11:21.834754 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:21.834718 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e1b673_c2d8_4f75_b7c2_ee368adc05bf.slice/crio-623173dad6b5df58c6d5753b54da04ce9167d91d47c97b7db3ef32d0fc55ee2c WatchSource:0}: Error finding container 623173dad6b5df58c6d5753b54da04ce9167d91d47c97b7db3ef32d0fc55ee2c: Status 404 returned error can't find the container with id 623173dad6b5df58c6d5753b54da04ce9167d91d47c97b7db3ef32d0fc55ee2c Jul 03 19:11:21.892313 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:21.892281 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:22.486083 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:22.486050 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:22.788949 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:22.788867 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:22.829313 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:22.829280 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" event={"ID":"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf","Type":"ContainerStarted","Data":"c4e4e6768843fe9969f38c28844304bfa027972cf4ebedba12e51a3491972bbb"} Jul 03 19:11:22.829468 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:22.829328 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" event={"ID":"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf","Type":"ContainerStarted","Data":"623173dad6b5df58c6d5753b54da04ce9167d91d47c97b7db3ef32d0fc55ee2c"} Jul 03 19:11:22.829468 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:22.829419 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:22.846727 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:22.846670 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" podStartSLOduration=17.846654708 podStartE2EDuration="17.846654708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:22.84584367 +0000 UTC m=+62.993495928" watchObservedRunningTime="2026-07-03 19:11:22.846654708 +0000 UTC m=+62.994306970" Jul 03 19:11:22.889161 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:22.889127 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:23.225350 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:23.225319 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:23.326713 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:23.326669 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:23.703208 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:23.703176 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:23.889341 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:23.889310 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:24.289655 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:24.289626 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:24.888376 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:24.888349 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:25.288241 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:25.288162 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:25.685895 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:25.685867 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:25.842323 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:25.842292 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:25.842481 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:25.842328 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:25.842481 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:25.842419 2587 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 03 19:11:25.842481 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:25.842467 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls podName:79fccd49-ac9b-4b7d-be42-f7c7b7a69e08 nodeName:}" failed. No retries permitted until 2026-07-03 19:11:41.842453356 +0000 UTC m=+81.990105592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6gq4v" (UID: "79fccd49-ac9b-4b7d-be42-f7c7b7a69e08") : secret "insights-runtime-extractor-tls" not found Jul 03 19:11:25.842805 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:25.842785 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:25.889486 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:25.889455 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:26.044025 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.043945 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:11:26.044025 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.043994 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:11:26.046140 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.046123 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 19:11:26.046856 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.046843 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 19:11:26.057156 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.057132 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e8d28707-c79a-489a-aef0-b389707b64c1-original-pull-secret\") pod \"global-pull-secret-syncer-lh4kg\" (UID: \"e8d28707-c79a-489a-aef0-b389707b64c1\") " pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:11:26.057255 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.057137 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/003930ac-166e-4958-b6e8-30444b6e6fec-metrics-certs\") pod \"network-metrics-daemon-dnsmw\" (UID: \"003930ac-166e-4958-b6e8-30444b6e6fec\") " pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:11:26.144645 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.144603 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn62s\" (UniqueName: \"kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s\") pod \"network-check-target-jkr57\" (UID: \"9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8\") " pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:11:26.147296 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.147278 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 19:11:26.149962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.149950 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lh4kg" Jul 03 19:11:26.156930 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.156910 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 19:11:26.168088 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.168054 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn62s\" (UniqueName: \"kubernetes.io/projected/9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8-kube-api-access-kn62s\") pod \"network-check-target-jkr57\" (UID: \"9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8\") " pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:11:26.256363 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.256338 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wwb25\"" Jul 03 19:11:26.265015 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.264985 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnsmw" Jul 03 19:11:26.273541 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.273514 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lh4kg"] Jul 03 19:11:26.276647 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:26.276616 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d28707_c79a_489a_aef0_b389707b64c1.slice/crio-3a68bc6bcf00d86c4075631e9b9e5b1b25b344099b2fe01964a3ae53b5310cf9 WatchSource:0}: Error finding container 3a68bc6bcf00d86c4075631e9b9e5b1b25b344099b2fe01964a3ae53b5310cf9: Status 404 returned error can't find the container with id 3a68bc6bcf00d86c4075631e9b9e5b1b25b344099b2fe01964a3ae53b5310cf9 Jul 03 19:11:26.404505 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.404471 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dnsmw"] Jul 03 19:11:26.407246 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:26.407219 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003930ac_166e_4958_b6e8_30444b6e6fec.slice/crio-df855d8a9ba050f06c1f608cb298392f2bf1dd82cd10ac5f4a77042e0503c2ba WatchSource:0}: Error finding container df855d8a9ba050f06c1f608cb298392f2bf1dd82cd10ac5f4a77042e0503c2ba: Status 404 returned error can't find the container with id df855d8a9ba050f06c1f608cb298392f2bf1dd82cd10ac5f4a77042e0503c2ba Jul 03 19:11:26.456559 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.456530 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g8gc2\"" Jul 03 19:11:26.465197 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.465178 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:11:26.494317 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.494291 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:26.621923 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.621844 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jkr57"] Jul 03 19:11:26.625177 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:26.625147 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f4d4d30_7d6f_4c57_b3c0_e3fd108fd1c8.slice/crio-8d4952db959edd3a63bc5feb86eb1e715af549c274fa7e725c1b30c838d856f4 WatchSource:0}: Error finding container 8d4952db959edd3a63bc5feb86eb1e715af549c274fa7e725c1b30c838d856f4: Status 404 returned error can't find the container with id 8d4952db959edd3a63bc5feb86eb1e715af549c274fa7e725c1b30c838d856f4 Jul 03 19:11:26.844558 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.844519 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lh4kg" event={"ID":"e8d28707-c79a-489a-aef0-b389707b64c1","Type":"ContainerStarted","Data":"3a68bc6bcf00d86c4075631e9b9e5b1b25b344099b2fe01964a3ae53b5310cf9"} Jul 03 19:11:26.845921 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.845887 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jkr57" event={"ID":"9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8","Type":"ContainerStarted","Data":"8d4952db959edd3a63bc5feb86eb1e715af549c274fa7e725c1b30c838d856f4"} Jul 03 19:11:26.847144 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.847114 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnsmw" event={"ID":"003930ac-166e-4958-b6e8-30444b6e6fec","Type":"ContainerStarted","Data":"df855d8a9ba050f06c1f608cb298392f2bf1dd82cd10ac5f4a77042e0503c2ba"} Jul 03 19:11:26.888104 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:26.887996 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:27.096207 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:27.096150 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:27.287233 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:27.287145 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:27.555365 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:27.555333 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:11:27.558389 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:27.558356 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/75adf88a-862f-446c-82a5-8bbd5992149d-metrics-tls\") pod \"dns-default-m826r\" (UID: \"75adf88a-862f-446c-82a5-8bbd5992149d\") " pod="openshift-dns/dns-default-m826r" Jul 03 19:11:27.833471 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:27.833412 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8lvgc\"" Jul 03 19:11:27.842089 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:27.842061 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m826r" Jul 03 19:11:28.012756 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:28.012560 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m826r"] Jul 03 19:11:28.016187 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:28.016141 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75adf88a_862f_446c_82a5_8bbd5992149d.slice/crio-b6c6c600b6567afa14a957caf834d95bfa57c15f362f0b4f4802d7b23d4fd33c WatchSource:0}: Error finding container b6c6c600b6567afa14a957caf834d95bfa57c15f362f0b4f4802d7b23d4fd33c: Status 404 returned error can't find the container with id b6c6c600b6567afa14a957caf834d95bfa57c15f362f0b4f4802d7b23d4fd33c Jul 03 19:11:28.745220 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:28.745124 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:28.846873 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:28.846674 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:28.856077 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:28.855987 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m826r" event={"ID":"75adf88a-862f-446c-82a5-8bbd5992149d","Type":"ContainerStarted","Data":"b6c6c600b6567afa14a957caf834d95bfa57c15f362f0b4f4802d7b23d4fd33c"} Jul 03 19:11:28.858814 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:28.858767 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnsmw" event={"ID":"003930ac-166e-4958-b6e8-30444b6e6fec","Type":"ContainerStarted","Data":"101bb49542b3a2b3c6db73baccb61e82d95f45de5bce7463d42c46d069f6ccd3"} Jul 03 19:11:28.858949 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:28.858841 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnsmw" event={"ID":"003930ac-166e-4958-b6e8-30444b6e6fec","Type":"ContainerStarted","Data":"d1f87912eebe79e45fd164c6abfa92f54b951f40480aa0bdcc344d13997a8bb1"} Jul 03 19:11:28.874375 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:28.874324 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dnsmw" podStartSLOduration=66.423968649 podStartE2EDuration="1m7.874307887s" totalImagesPullingTime="1.450339238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:28.872326976 +0000 UTC m=+69.019979235" watchObservedRunningTime="2026-07-03 19:11:28.874307887 +0000 UTC m=+69.021960145" Jul 03 19:11:28.900358 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:28.900303 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:29.052972 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:29.052932 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:29.426485 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:29.426399 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:29.486799 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:29.486409 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:29.833657 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:29.833600 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:29.884267 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:29.884209 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:30.028266 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:30.028232 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:30.241273 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:30.241194 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:30.432808 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:30.432766 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:30.530187 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:30.530106 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:30.704675 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:30.704646 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:30.833737 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:30.833699 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:31.485349 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.485319 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf"] Jul 03 19:11:31.488087 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.488058 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf" Jul 03 19:11:31.492106 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.492087 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 03 19:11:31.492237 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.492128 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 03 19:11:31.492237 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.492171 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-klc2c\"" Jul 03 19:11:31.492350 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.492296 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 03 19:11:31.492402 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.492386 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 03 19:11:31.502822 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.502763 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf"] Jul 03 19:11:31.523253 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.523228 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-bnnvk"] Jul 03 19:11:31.525746 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.525719 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-bnnvk" Jul 03 19:11:31.526640 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.526617 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6686459f4f-rcb5g"] Jul 03 19:11:31.528622 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.528508 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 03 19:11:31.529883 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.529845 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9bjkc\"" Jul 03 19:11:31.530014 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.529994 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 03 19:11:31.539750 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.539697 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-bnnvk"] Jul 03 19:11:31.564175 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.564006 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f74775789-msxqv"] Jul 03 19:11:31.566192 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.566170 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.578233 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.578210 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f74775789-msxqv"] Jul 03 19:11:31.586851 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.586829 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d44d94f78-cwlhf\" (UID: \"316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf" Jul 03 19:11:31.586988 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.586872 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hftt\" (UniqueName: \"kubernetes.io/projected/316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2-kube-api-access-5hftt\") pod \"managed-serviceaccount-addon-agent-6d44d94f78-cwlhf\" (UID: \"316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf" Jul 03 19:11:31.586988 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.586900 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f665r\" (UniqueName: \"kubernetes.io/projected/6e093c33-3873-43c2-a004-41e8569b2f71-kube-api-access-f665r\") pod \"downloads-685bfb5f64-bnnvk\" (UID: \"6e093c33-3873-43c2-a004-41e8569b2f71\") " pod="openshift-console/downloads-685bfb5f64-bnnvk" Jul 03 19:11:31.593035 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.593014 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:31.686791 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.686728 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:31.687883 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.687856 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48be8335-ed20-45ae-957d-e97347c724a2-registry-tls\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.688022 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.687920 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d44d94f78-cwlhf\" (UID: \"316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf" Jul 03 19:11:31.688022 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.687947 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48be8335-ed20-45ae-957d-e97347c724a2-ca-trust-extracted\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.688022 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.687974 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48be8335-ed20-45ae-957d-e97347c724a2-registry-certificates\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.688022 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.688009 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48be8335-ed20-45ae-957d-e97347c724a2-image-registry-private-configuration\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.688240 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.688043 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48be8335-ed20-45ae-957d-e97347c724a2-installation-pull-secrets\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.688240 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.688079 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hftt\" (UniqueName: \"kubernetes.io/projected/316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2-kube-api-access-5hftt\") pod \"managed-serviceaccount-addon-agent-6d44d94f78-cwlhf\" (UID: \"316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf" Jul 03 19:11:31.688240 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.688133 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpm26\" (UniqueName: \"kubernetes.io/projected/48be8335-ed20-45ae-957d-e97347c724a2-kube-api-access-hpm26\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.688240 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.688162 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f665r\" (UniqueName: \"kubernetes.io/projected/6e093c33-3873-43c2-a004-41e8569b2f71-kube-api-access-f665r\") pod \"downloads-685bfb5f64-bnnvk\" (UID: \"6e093c33-3873-43c2-a004-41e8569b2f71\") " pod="openshift-console/downloads-685bfb5f64-bnnvk" Jul 03 19:11:31.688240 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.688191 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48be8335-ed20-45ae-957d-e97347c724a2-bound-sa-token\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.688240 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.688232 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48be8335-ed20-45ae-957d-e97347c724a2-trusted-ca\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.691233 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.691206 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d44d94f78-cwlhf\" (UID: \"316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf" Jul 03 19:11:31.701074 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.701043 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hftt\" (UniqueName: \"kubernetes.io/projected/316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2-kube-api-access-5hftt\") pod \"managed-serviceaccount-addon-agent-6d44d94f78-cwlhf\" (UID: \"316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf" Jul 03 19:11:31.706563 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.706539 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f665r\" (UniqueName: \"kubernetes.io/projected/6e093c33-3873-43c2-a004-41e8569b2f71-kube-api-access-f665r\") pod \"downloads-685bfb5f64-bnnvk\" (UID: \"6e093c33-3873-43c2-a004-41e8569b2f71\") " pod="openshift-console/downloads-685bfb5f64-bnnvk" Jul 03 19:11:31.788789 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.788753 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48be8335-ed20-45ae-957d-e97347c724a2-registry-tls\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.788901 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.788834 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48be8335-ed20-45ae-957d-e97347c724a2-ca-trust-extracted\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.788901 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.788870 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:31.789013 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.788904 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48be8335-ed20-45ae-957d-e97347c724a2-registry-certificates\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.789089 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.789066 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48be8335-ed20-45ae-957d-e97347c724a2-image-registry-private-configuration\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.789156 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.789118 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48be8335-ed20-45ae-957d-e97347c724a2-installation-pull-secrets\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.789220 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.789152 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpm26\" (UniqueName: \"kubernetes.io/projected/48be8335-ed20-45ae-957d-e97347c724a2-kube-api-access-hpm26\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.789220 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.789186 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48be8335-ed20-45ae-957d-e97347c724a2-bound-sa-token\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.789319 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.789225 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48be8335-ed20-45ae-957d-e97347c724a2-trusted-ca\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.789319 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.789233 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/48be8335-ed20-45ae-957d-e97347c724a2-ca-trust-extracted\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.789802 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.789687 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/48be8335-ed20-45ae-957d-e97347c724a2-registry-certificates\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.790816 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.790747 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48be8335-ed20-45ae-957d-e97347c724a2-trusted-ca\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.792152 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.792130 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/48be8335-ed20-45ae-957d-e97347c724a2-installation-pull-secrets\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.792152 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.792145 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/48be8335-ed20-45ae-957d-e97347c724a2-registry-tls\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.792394 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.792373 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/48be8335-ed20-45ae-957d-e97347c724a2-image-registry-private-configuration\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.796883 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.796862 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpm26\" (UniqueName: \"kubernetes.io/projected/48be8335-ed20-45ae-957d-e97347c724a2-kube-api-access-hpm26\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.800502 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.800451 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48be8335-ed20-45ae-957d-e97347c724a2-bound-sa-token\") pod \"image-registry-5f74775789-msxqv\" (UID: \"48be8335-ed20-45ae-957d-e97347c724a2\") " pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.809859 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.809836 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf" Jul 03 19:11:31.837481 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.837234 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-bnnvk" Jul 03 19:11:31.875794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.875540 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:31.879049 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.879002 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jkr57" event={"ID":"9f4d4d30-7d6f-4c57-b3c0-e3fd108fd1c8","Type":"ContainerStarted","Data":"c293c0ae0a49639d78084d22e1f4599b6a76084a4ca18492fb6c070bb3bb32e1"} Jul 03 19:11:31.879292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.879244 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:11:31.896521 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.893146 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jkr57" podStartSLOduration=65.747459014 podStartE2EDuration="1m10.893124695s" totalImagesPullingTime="5.145665681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:31.892865278 +0000 UTC m=+72.040517570" watchObservedRunningTime="2026-07-03 19:11:31.893124695 +0000 UTC m=+72.040776954" Jul 03 19:11:31.901863 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:31.901143 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:32.010266 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.010233 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf"] Jul 03 19:11:32.014608 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:32.014578 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod316ff8ff_bef8_49d4_9b22_9a2b3ccbd4e2.slice/crio-462311a1eafebc4d053a88bd470f6946fee4500fdc6b69d88e43421998dab6f9 WatchSource:0}: Error finding container 462311a1eafebc4d053a88bd470f6946fee4500fdc6b69d88e43421998dab6f9: Status 404 returned error can't find the container with id 462311a1eafebc4d053a88bd470f6946fee4500fdc6b69d88e43421998dab6f9 Jul 03 19:11:32.035841 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.035814 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-bnnvk"] Jul 03 19:11:32.040239 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:32.040196 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e093c33_3873_43c2_a004_41e8569b2f71.slice/crio-174e79f5994f60cbefe0895bad1b143160a9ee60ff7f5b1b9c85cedc7a708f6c WatchSource:0}: Error finding container 174e79f5994f60cbefe0895bad1b143160a9ee60ff7f5b1b9c85cedc7a708f6c: Status 404 returned error can't find the container with id 174e79f5994f60cbefe0895bad1b143160a9ee60ff7f5b1b9c85cedc7a708f6c Jul 03 19:11:32.072230 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.072164 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f74775789-msxqv"] Jul 03 19:11:32.077344 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:32.077317 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48be8335_ed20_45ae_957d_e97347c724a2.slice/crio-918e70892be8619a7f62556a784525cc44ae4658407d932e00d643fad7981bb1 WatchSource:0}: Error finding container 918e70892be8619a7f62556a784525cc44ae4658407d932e00d643fad7981bb1: Status 404 returned error can't find the container with id 918e70892be8619a7f62556a784525cc44ae4658407d932e00d643fad7981bb1 Jul 03 19:11:32.253029 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.252997 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:32.376062 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.376032 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:32.884993 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.884953 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lh4kg" event={"ID":"e8d28707-c79a-489a-aef0-b389707b64c1","Type":"ContainerStarted","Data":"8224d73b2eb4e0cb7f0798e7bf93f3d6e6e3911e0aa21df6140cf6a110b166de"} Jul 03 19:11:32.887060 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.887032 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m826r" event={"ID":"75adf88a-862f-446c-82a5-8bbd5992149d","Type":"ContainerStarted","Data":"04ebcc174df21ca9d29b39e4529a414d14f466876c0758865947b9b2810d6497"} Jul 03 19:11:32.887177 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.887087 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m826r" event={"ID":"75adf88a-862f-446c-82a5-8bbd5992149d","Type":"ContainerStarted","Data":"7189c76b5ef23e7eb57bfed13dd777617d55c4e61295ab8ec26763793eec5b07"} Jul 03 19:11:32.887279 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.887260 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m826r" Jul 03 19:11:32.888510 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.888485 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf" event={"ID":"316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2","Type":"ContainerStarted","Data":"462311a1eafebc4d053a88bd470f6946fee4500fdc6b69d88e43421998dab6f9"} Jul 03 19:11:32.890125 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.890101 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f74775789-msxqv" event={"ID":"48be8335-ed20-45ae-957d-e97347c724a2","Type":"ContainerStarted","Data":"eb419f213f5560bebde32bca24b2947590169758078ac30dd99a8fb77dd76ece"} Jul 03 19:11:32.890222 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.890145 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:32.890222 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.890161 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f74775789-msxqv" event={"ID":"48be8335-ed20-45ae-957d-e97347c724a2","Type":"ContainerStarted","Data":"918e70892be8619a7f62556a784525cc44ae4658407d932e00d643fad7981bb1"} Jul 03 19:11:32.891338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.891298 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-bnnvk" event={"ID":"6e093c33-3873-43c2-a004-41e8569b2f71","Type":"ContainerStarted","Data":"174e79f5994f60cbefe0895bad1b143160a9ee60ff7f5b1b9c85cedc7a708f6c"} Jul 03 19:11:32.899883 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.899726 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lh4kg" podStartSLOduration=66.394753029 podStartE2EDuration="1m11.899707734s" totalImagesPullingTime="5.504954705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:10:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:32.899662075 +0000 UTC m=+73.047314353" watchObservedRunningTime="2026-07-03 19:11:32.899707734 +0000 UTC m=+73.047360017" Jul 03 19:11:32.914834 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.914767 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m826r" podStartSLOduration=34.155320082 podStartE2EDuration="37.914745071s" totalImagesPullingTime="3.759424989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:32.913365676 +0000 UTC m=+73.061017937" watchObservedRunningTime="2026-07-03 19:11:32.914745071 +0000 UTC m=+73.062397329" Jul 03 19:11:32.935175 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:32.935120 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f74775789-msxqv" podStartSLOduration=1.935100735 podStartE2EDuration="1.935100735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:32.935057138 +0000 UTC m=+73.082709416" watchObservedRunningTime="2026-07-03 19:11:32.935100735 +0000 UTC m=+73.082752986" Jul 03 19:11:34.512252 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:34.512213 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:34.612293 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:34.612264 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:37.537218 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:37.537171 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:37.539865 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:37.539837 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c792b24-59a4-4c99-b77b-c3709eba2bea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-pj7ns\" (UID: \"0c792b24-59a4-4c99-b77b-c3709eba2bea\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:37.769765 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:37.769649 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jkf85\"" Jul 03 19:11:37.777765 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:37.777530 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" Jul 03 19:11:37.967959 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:37.967922 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns"] Jul 03 19:11:37.975003 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:37.974974 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c792b24_59a4_4c99_b77b_c3709eba2bea.slice/crio-7b2aac8b907e8a3e180cd893b7d5c55bd56614626360736843f6ee39be22b780 WatchSource:0}: Error finding container 7b2aac8b907e8a3e180cd893b7d5c55bd56614626360736843f6ee39be22b780: Status 404 returned error can't find the container with id 7b2aac8b907e8a3e180cd893b7d5c55bd56614626360736843f6ee39be22b780 Jul 03 19:11:38.919042 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:38.919005 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" event={"ID":"0c792b24-59a4-4c99-b77b-c3709eba2bea","Type":"ContainerStarted","Data":"7b2aac8b907e8a3e180cd893b7d5c55bd56614626360736843f6ee39be22b780"} Jul 03 19:11:40.809551 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:40.809436 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:40.909447 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:40.909410 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:40.934002 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:40.933947 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" event={"ID":"0c792b24-59a4-4c99-b77b-c3709eba2bea","Type":"ContainerStarted","Data":"2fb881fd5a90aa1257de912ed6528db86e9070164abb35f4c867c5231a4a7d4d"} Jul 03 19:11:40.936072 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:40.936048 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf" event={"ID":"316ff8ff-bef8-49d4-9b22-9a2b3ccbd4e2","Type":"ContainerStarted","Data":"e3232a4ce5e18ef5e4f710bfbb34622e60f4faa45fc62ce3432871f4b4f409a1"} Jul 03 19:11:40.950698 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:40.950645 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-pj7ns" podStartSLOduration=33.464061709 podStartE2EDuration="35.95063004s" totalImagesPullingTime="2.486568331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:40.949748294 +0000 UTC m=+81.097400574" watchObservedRunningTime="2026-07-03 19:11:40.95063004 +0000 UTC m=+81.098282298" Jul 03 19:11:40.970358 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:40.966522 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d44d94f78-cwlhf" podStartSLOduration=1.516788646 podStartE2EDuration="9.966502852s" totalImagesPullingTime="8.449714206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:40.964980711 +0000 UTC m=+81.112632973" watchObservedRunningTime="2026-07-03 19:11:40.966502852 +0000 UTC m=+81.114155112" Jul 03 19:11:40.983018 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:40.982977 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:41.118273 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:41.118186 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:41.534369 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:41.534289 2587 patch_prober.go:28] interesting pod/image-registry-6686459f4f-rcb5g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 03 19:11:41.534369 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:41.534337 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" podUID="e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 03 19:11:41.874988 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:41.874950 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:41.877689 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:41.877654 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79fccd49-ac9b-4b7d-be42-f7c7b7a69e08-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6gq4v\" (UID: \"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08\") " pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:41.895488 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:41.895459 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lkngf\"" Jul 03 19:11:41.903258 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:41.903229 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6gq4v" Jul 03 19:11:42.898010 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:42.897983 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m826r" Jul 03 19:11:43.991984 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:43.991948 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:44.052644 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:44.052607 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:44.198399 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:44.198366 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:45.449803 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:45.449757 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:45.504883 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:45.504852 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:46.075909 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.075872 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c584d976b-nmsbj"] Jul 03 19:11:46.078785 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.078751 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.081100 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.081078 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 03 19:11:46.081221 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.081119 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 03 19:11:46.081221 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.081164 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 03 19:11:46.081995 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.081976 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 03 19:11:46.081995 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.081995 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q5m62\"" Jul 03 19:11:46.082130 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.081987 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 03 19:11:46.087643 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.087606 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c584d976b-nmsbj"] Jul 03 19:11:46.207392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.207351 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/997f560d-7471-4256-ab56-eb2af72162e1-console-oauth-config\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.207585 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.207430 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-console-config\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.207585 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.207451 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-oauth-serving-cert\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.207585 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.207489 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4crfh\" (UniqueName: \"kubernetes.io/projected/997f560d-7471-4256-ab56-eb2af72162e1-kube-api-access-4crfh\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.207585 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.207524 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/997f560d-7471-4256-ab56-eb2af72162e1-console-serving-cert\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.207585 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.207572 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-service-ca\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.308658 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.308618 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4crfh\" (UniqueName: \"kubernetes.io/projected/997f560d-7471-4256-ab56-eb2af72162e1-kube-api-access-4crfh\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.308850 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.308675 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/997f560d-7471-4256-ab56-eb2af72162e1-console-serving-cert\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.308850 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.308706 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-service-ca\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.308850 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.308730 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/997f560d-7471-4256-ab56-eb2af72162e1-console-oauth-config\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.308850 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.308809 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-console-config\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.309063 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.308941 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-oauth-serving-cert\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.309736 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.309701 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-console-config\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.309937 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.309807 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-service-ca\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.309937 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.309835 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-oauth-serving-cert\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.311711 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.311678 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/997f560d-7471-4256-ab56-eb2af72162e1-console-serving-cert\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.311811 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.311725 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/997f560d-7471-4256-ab56-eb2af72162e1-console-oauth-config\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.316720 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.316691 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4crfh\" (UniqueName: \"kubernetes.io/projected/997f560d-7471-4256-ab56-eb2af72162e1-kube-api-access-4crfh\") pod \"console-c584d976b-nmsbj\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.391453 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.391370 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:11:46.799926 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.799898 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:46.854830 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:46.854766 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:47.671824 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:47.671762 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:48.459042 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:48.459001 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:48.509926 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:48.509894 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:48.609901 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:48.609875 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c584d976b-nmsbj"] Jul 03 19:11:48.613001 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:48.612977 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod997f560d_7471_4256_ab56_eb2af72162e1.slice/crio-4954b2e45c6366a446c2b1880afba22299d835d0b47067900bde015c5f41ca57 WatchSource:0}: Error finding container 4954b2e45c6366a446c2b1880afba22299d835d0b47067900bde015c5f41ca57: Status 404 returned error can't find the container with id 4954b2e45c6366a446c2b1880afba22299d835d0b47067900bde015c5f41ca57 Jul 03 19:11:48.628005 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:48.627984 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6gq4v"] Jul 03 19:11:48.632451 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:48.632420 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fccd49_ac9b_4b7d_be42_f7c7b7a69e08.slice/crio-0d5de3adc71f231033be9ac862b977955db05af37412c890a7dbc347e31bc440 WatchSource:0}: Error finding container 0d5de3adc71f231033be9ac862b977955db05af37412c890a7dbc347e31bc440: Status 404 returned error can't find the container with id 0d5de3adc71f231033be9ac862b977955db05af37412c890a7dbc347e31bc440 Jul 03 19:11:48.966628 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:48.966533 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-bnnvk" event={"ID":"6e093c33-3873-43c2-a004-41e8569b2f71","Type":"ContainerStarted","Data":"069cce74fa85396dacf082d71c0b7d66182486350ff962e5a5c741cdd7a85c2b"} Jul 03 19:11:48.966628 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:48.966592 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-bnnvk" Jul 03 19:11:48.967967 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:48.967932 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gq4v" event={"ID":"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08","Type":"ContainerStarted","Data":"0d5de3adc71f231033be9ac862b977955db05af37412c890a7dbc347e31bc440"} Jul 03 19:11:48.969163 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:48.969127 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c584d976b-nmsbj" event={"ID":"997f560d-7471-4256-ab56-eb2af72162e1","Type":"ContainerStarted","Data":"4954b2e45c6366a446c2b1880afba22299d835d0b47067900bde015c5f41ca57"} Jul 03 19:11:48.972496 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:48.972479 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-bnnvk" Jul 03 19:11:48.984625 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:48.984580 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-bnnvk" podStartSLOduration=1.425212994 podStartE2EDuration="17.984561045s" totalImagesPullingTime="16.559348051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:48.983094333 +0000 UTC m=+89.130746596" watchObservedRunningTime="2026-07-03 19:11:48.984561045 +0000 UTC m=+89.132213303" Jul 03 19:11:50.141348 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.141266 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:50.236303 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.236270 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:50.368754 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.368676 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:50.385424 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.385292 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq"] Jul 03 19:11:50.403661 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.402028 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8"] Jul 03 19:11:50.409912 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.403931 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.409912 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.407925 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 03 19:11:50.409912 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.408132 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 03 19:11:50.409912 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.408304 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 03 19:11:50.411088 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.410715 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l42tk\"" Jul 03 19:11:50.419874 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.419815 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pkql9"] Jul 03 19:11:50.421538 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.420368 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.423961 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.422858 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gqgnr\"" Jul 03 19:11:50.423961 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.423256 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 03 19:11:50.423961 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.423464 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 03 19:11:50.423961 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.423685 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 03 19:11:50.437150 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.437044 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq"] Jul 03 19:11:50.437150 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.437108 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8"] Jul 03 19:11:50.437326 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.437239 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.440742 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.440719 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 03 19:11:50.440859 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.440844 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ffmmx\"" Jul 03 19:11:50.440924 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.440729 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 03 19:11:50.441259 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.441237 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 03 19:11:50.456475 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.456354 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:50.551478 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551442 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsllk\" (UniqueName: \"kubernetes.io/projected/857dd60a-05ec-4a42-a546-9e210c61a80e-kube-api-access-gsllk\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.551667 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551496 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6zxt\" (UniqueName: \"kubernetes.io/projected/67860888-f04c-418a-82e6-c65f7fc571e7-kube-api-access-k6zxt\") pod \"openshift-state-metrics-54cf96dfcf-r8zsq\" (UID: \"67860888-f04c-418a-82e6-c65f7fc571e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.551667 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551522 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08faacaf-14ab-4422-b2fd-62caa9c0f33e-sys\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.551667 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551556 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.551667 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551584 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/08faacaf-14ab-4422-b2fd-62caa9c0f33e-root\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.551667 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551609 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/857dd60a-05ec-4a42-a546-9e210c61a80e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.551667 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551634 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08faacaf-14ab-4422-b2fd-62caa9c0f33e-metrics-client-ca\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.551667 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551661 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-accelerators-collector-config\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.552055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551698 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/857dd60a-05ec-4a42-a546-9e210c61a80e-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.552055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551724 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/857dd60a-05ec-4a42-a546-9e210c61a80e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.552055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551752 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/857dd60a-05ec-4a42-a546-9e210c61a80e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.552055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551814 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-textfile\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.552055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551849 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67860888-f04c-418a-82e6-c65f7fc571e7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-r8zsq\" (UID: \"67860888-f04c-418a-82e6-c65f7fc571e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.552055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551893 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67860888-f04c-418a-82e6-c65f7fc571e7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-r8zsq\" (UID: \"67860888-f04c-418a-82e6-c65f7fc571e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.552055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551936 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67860888-f04c-418a-82e6-c65f7fc571e7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-r8zsq\" (UID: \"67860888-f04c-418a-82e6-c65f7fc571e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.552055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551966 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-tls\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.552055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.551991 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sz2k\" (UniqueName: \"kubernetes.io/projected/08faacaf-14ab-4422-b2fd-62caa9c0f33e-kube-api-access-8sz2k\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.552055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.552020 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-wtmp\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.552055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.552053 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/857dd60a-05ec-4a42-a546-9e210c61a80e-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.557288 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.557247 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:50.653529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653151 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-accelerators-collector-config\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.653529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653208 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/857dd60a-05ec-4a42-a546-9e210c61a80e-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.653529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653237 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/857dd60a-05ec-4a42-a546-9e210c61a80e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.653529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653268 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/857dd60a-05ec-4a42-a546-9e210c61a80e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.653529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653301 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-textfile\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.653529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653331 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67860888-f04c-418a-82e6-c65f7fc571e7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-r8zsq\" (UID: \"67860888-f04c-418a-82e6-c65f7fc571e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.653529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653374 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67860888-f04c-418a-82e6-c65f7fc571e7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-r8zsq\" (UID: \"67860888-f04c-418a-82e6-c65f7fc571e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.653529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653413 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67860888-f04c-418a-82e6-c65f7fc571e7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-r8zsq\" (UID: \"67860888-f04c-418a-82e6-c65f7fc571e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.653529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653441 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-tls\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.653529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653465 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sz2k\" (UniqueName: \"kubernetes.io/projected/08faacaf-14ab-4422-b2fd-62caa9c0f33e-kube-api-access-8sz2k\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.653529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653495 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-wtmp\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.653529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653525 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/857dd60a-05ec-4a42-a546-9e210c61a80e-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.654437 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653550 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsllk\" (UniqueName: \"kubernetes.io/projected/857dd60a-05ec-4a42-a546-9e210c61a80e-kube-api-access-gsllk\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.654437 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653579 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6zxt\" (UniqueName: \"kubernetes.io/projected/67860888-f04c-418a-82e6-c65f7fc571e7-kube-api-access-k6zxt\") pod \"openshift-state-metrics-54cf96dfcf-r8zsq\" (UID: \"67860888-f04c-418a-82e6-c65f7fc571e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.654437 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653598 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08faacaf-14ab-4422-b2fd-62caa9c0f33e-sys\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.654437 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653628 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.654437 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653655 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/08faacaf-14ab-4422-b2fd-62caa9c0f33e-root\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.654437 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653682 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/857dd60a-05ec-4a42-a546-9e210c61a80e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.654437 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.653706 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08faacaf-14ab-4422-b2fd-62caa9c0f33e-metrics-client-ca\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.655292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.654905 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08faacaf-14ab-4422-b2fd-62caa9c0f33e-sys\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.655292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.654944 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:50.655292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.655028 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08faacaf-14ab-4422-b2fd-62caa9c0f33e-metrics-client-ca\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.655292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.655109 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/08faacaf-14ab-4422-b2fd-62caa9c0f33e-root\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.655292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.655192 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-wtmp\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.655629 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.655595 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-textfile\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.655701 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.655683 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/857dd60a-05ec-4a42-a546-9e210c61a80e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.656343 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.655992 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/857dd60a-05ec-4a42-a546-9e210c61a80e-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.656343 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.656202 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-accelerators-collector-config\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.656343 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.656296 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67860888-f04c-418a-82e6-c65f7fc571e7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-r8zsq\" (UID: \"67860888-f04c-418a-82e6-c65f7fc571e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.656561 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.656391 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/857dd60a-05ec-4a42-a546-9e210c61a80e-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.657448 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.657420 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-tls\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.660456 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.660435 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08faacaf-14ab-4422-b2fd-62caa9c0f33e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.663487 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.663111 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/67860888-f04c-418a-82e6-c65f7fc571e7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-r8zsq\" (UID: \"67860888-f04c-418a-82e6-c65f7fc571e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.665929 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.665865 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/857dd60a-05ec-4a42-a546-9e210c61a80e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.665929 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.665881 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/857dd60a-05ec-4a42-a546-9e210c61a80e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.666724 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.666685 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/67860888-f04c-418a-82e6-c65f7fc571e7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-r8zsq\" (UID: \"67860888-f04c-418a-82e6-c65f7fc571e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.669217 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.669157 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6zxt\" (UniqueName: \"kubernetes.io/projected/67860888-f04c-418a-82e6-c65f7fc571e7-kube-api-access-k6zxt\") pod \"openshift-state-metrics-54cf96dfcf-r8zsq\" (UID: \"67860888-f04c-418a-82e6-c65f7fc571e7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.669912 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.669858 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsllk\" (UniqueName: \"kubernetes.io/projected/857dd60a-05ec-4a42-a546-9e210c61a80e-kube-api-access-gsllk\") pod \"kube-state-metrics-7c9dbb8b7d-x4st8\" (UID: \"857dd60a-05ec-4a42-a546-9e210c61a80e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.671466 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.671370 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sz2k\" (UniqueName: \"kubernetes.io/projected/08faacaf-14ab-4422-b2fd-62caa9c0f33e-kube-api-access-8sz2k\") pod \"node-exporter-pkql9\" (UID: \"08faacaf-14ab-4422-b2fd-62caa9c0f33e\") " pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.723147 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.722915 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" Jul 03 19:11:50.735985 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.735923 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" Jul 03 19:11:50.752940 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.752877 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pkql9" Jul 03 19:11:50.755110 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.755083 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:50.943056 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.942976 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq"] Jul 03 19:11:50.950575 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:50.950478 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67860888_f04c_418a_82e6_c65f7fc571e7.slice/crio-eb39457511dbb83c89ec08b5e1ae1427a4ff71e147712f3c6ac3fbe3f2c609bd WatchSource:0}: Error finding container eb39457511dbb83c89ec08b5e1ae1427a4ff71e147712f3c6ac3fbe3f2c609bd: Status 404 returned error can't find the container with id eb39457511dbb83c89ec08b5e1ae1427a4ff71e147712f3c6ac3fbe3f2c609bd Jul 03 19:11:50.965020 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.963636 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8"] Jul 03 19:11:50.966127 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:50.966100 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod857dd60a_05ec_4a42_a546_9e210c61a80e.slice/crio-29a8dce7ffe09c7461be3683df7baf9e1555ed116402beeaebb04f9b45dc306a WatchSource:0}: Error finding container 29a8dce7ffe09c7461be3683df7baf9e1555ed116402beeaebb04f9b45dc306a: Status 404 returned error can't find the container with id 29a8dce7ffe09c7461be3683df7baf9e1555ed116402beeaebb04f9b45dc306a Jul 03 19:11:50.980670 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.980634 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" event={"ID":"857dd60a-05ec-4a42-a546-9e210c61a80e","Type":"ContainerStarted","Data":"29a8dce7ffe09c7461be3683df7baf9e1555ed116402beeaebb04f9b45dc306a"} Jul 03 19:11:50.982938 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.982907 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pkql9" event={"ID":"08faacaf-14ab-4422-b2fd-62caa9c0f33e","Type":"ContainerStarted","Data":"32c3a9dfeadf13b346431fab7ffa595234395ab8335d389a37b1580020fea20d"} Jul 03 19:11:50.985019 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:50.984943 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" event={"ID":"67860888-f04c-418a-82e6-c65f7fc571e7","Type":"ContainerStarted","Data":"eb39457511dbb83c89ec08b5e1ae1427a4ff71e147712f3c6ac3fbe3f2c609bd"} Jul 03 19:11:51.114570 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.114504 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:51.260683 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.260650 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:51.368642 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.368610 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:51.455143 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.455059 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:51.456716 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.456692 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 19:11:51.481303 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.481271 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.482118 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.481149 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 19:11:51.492103 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.491001 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 03 19:11:51.492103 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.491287 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 03 19:11:51.494184 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.492459 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 03 19:11:51.494184 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.492676 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 03 19:11:51.494184 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.492896 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 03 19:11:51.494184 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.493300 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 03 19:11:51.494184 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.493540 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 03 19:11:51.494184 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.493737 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 03 19:11:51.494184 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.493955 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 03 19:11:51.494184 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.494029 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fpt2k\"" Jul 03 19:11:51.520118 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.520063 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:51.534578 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.534156 2587 patch_prober.go:28] interesting pod/image-registry-6686459f4f-rcb5g container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 03 19:11:51.534578 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.534219 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" podUID="e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 03 19:11:51.564798 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.564747 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.565005 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.564840 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfg6m\" (UniqueName: \"kubernetes.io/projected/0bc57989-30d3-4565-9068-df9bb68cf13a-kube-api-access-sfg6m\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.565005 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.564867 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bc57989-30d3-4565-9068-df9bb68cf13a-config-out\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.565005 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.564918 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.565005 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.564948 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-web-config\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.565005 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.564982 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.565440 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.565032 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-config-volume\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.565440 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.565056 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bc57989-30d3-4565-9068-df9bb68cf13a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.565440 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.565148 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bc57989-30d3-4565-9068-df9bb68cf13a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.565440 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.565170 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.565440 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.565196 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.565440 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.565221 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0bc57989-30d3-4565-9068-df9bb68cf13a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.565440 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.565243 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bc57989-30d3-4565-9068-df9bb68cf13a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.665953 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bc57989-30d3-4565-9068-df9bb68cf13a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.665998 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.666034 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.666060 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0bc57989-30d3-4565-9068-df9bb68cf13a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.666085 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bc57989-30d3-4565-9068-df9bb68cf13a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.666119 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.666148 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfg6m\" (UniqueName: \"kubernetes.io/projected/0bc57989-30d3-4565-9068-df9bb68cf13a-kube-api-access-sfg6m\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.666170 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bc57989-30d3-4565-9068-df9bb68cf13a-config-out\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.666204 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.666231 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-web-config\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.666264 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.666318 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-config-volume\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.666339 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bc57989-30d3-4565-9068-df9bb68cf13a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.668209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.667088 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bc57989-30d3-4565-9068-df9bb68cf13a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.671616 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.670485 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bc57989-30d3-4565-9068-df9bb68cf13a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.671616 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:51.670833 2587 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 03 19:11:51.671616 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:11:51.670896 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-main-tls podName:0bc57989-30d3-4565-9068-df9bb68cf13a nodeName:}" failed. No retries permitted until 2026-07-03 19:11:52.170875137 +0000 UTC m=+92.318527377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a") : secret "alertmanager-main-tls" not found Jul 03 19:11:51.673491 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.673301 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0bc57989-30d3-4565-9068-df9bb68cf13a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.685694 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.685420 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.685694 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.685591 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bc57989-30d3-4565-9068-df9bb68cf13a-config-out\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.686909 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.686869 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-web-config\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.686999 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.686966 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.688012 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.687345 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bc57989-30d3-4565-9068-df9bb68cf13a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.688012 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.687686 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.689334 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.688452 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-config-volume\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.689334 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.688749 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.689334 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.689294 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfg6m\" (UniqueName: \"kubernetes.io/projected/0bc57989-30d3-4565-9068-df9bb68cf13a-kube-api-access-sfg6m\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:51.865070 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.863969 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-787dc45bf5-5vqzq"] Jul 03 19:11:51.895708 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.895599 2587 patch_prober.go:28] interesting pod/image-registry-5f74775789-msxqv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 03 19:11:51.896038 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.895975 2587 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5f74775789-msxqv" podUID="48be8335-ed20-45ae-957d-e97347c724a2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 03 19:11:51.905699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.904993 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787dc45bf5-5vqzq"] Jul 03 19:11:51.905699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.905100 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:51.915408 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.915385 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 03 19:11:51.994178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.994135 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" event={"ID":"67860888-f04c-418a-82e6-c65f7fc571e7","Type":"ContainerStarted","Data":"cec1a4a357a72abb5fbf1b346afb0b61a34fa041c3601d7d1aafbd2c987a52d3"} Jul 03 19:11:51.994338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:51.994206 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" event={"ID":"67860888-f04c-418a-82e6-c65f7fc571e7","Type":"ContainerStarted","Data":"cefab61b34ef36f101e135474b781f508c4e1f12364ad480b2bc791e23c027de"} Jul 03 19:11:52.014548 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.014473 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:52.070938 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.070493 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4rv5\" (UniqueName: \"kubernetes.io/projected/d31c7013-f88d-474c-95e3-c4336eb21522-kube-api-access-n4rv5\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.070938 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.070551 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-oauth-serving-cert\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.070938 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.070594 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-trusted-ca-bundle\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.070938 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.070625 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-console-config\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.070938 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.070689 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d31c7013-f88d-474c-95e3-c4336eb21522-console-oauth-config\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.070938 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.070727 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d31c7013-f88d-474c-95e3-c4336eb21522-console-serving-cert\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.070938 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.070756 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-service-ca\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.116147 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.116047 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:52.172800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.171328 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d31c7013-f88d-474c-95e3-c4336eb21522-console-oauth-config\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.172800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.171382 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d31c7013-f88d-474c-95e3-c4336eb21522-console-serving-cert\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.172800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.171414 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-service-ca\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.172800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.171461 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:52.172800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.171505 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4rv5\" (UniqueName: \"kubernetes.io/projected/d31c7013-f88d-474c-95e3-c4336eb21522-kube-api-access-n4rv5\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.172800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.171544 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-oauth-serving-cert\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.172800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.171587 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-trusted-ca-bundle\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.172800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.171614 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-console-config\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.172800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.172421 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-console-config\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.172800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.172590 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-oauth-serving-cert\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.173421 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.173325 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-trusted-ca-bundle\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.173421 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.173345 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-service-ca\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.176040 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.175997 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d31c7013-f88d-474c-95e3-c4336eb21522-console-oauth-config\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.191833 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.187736 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d31c7013-f88d-474c-95e3-c4336eb21522-console-serving-cert\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.191833 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.190905 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4rv5\" (UniqueName: \"kubernetes.io/projected/d31c7013-f88d-474c-95e3-c4336eb21522-kube-api-access-n4rv5\") pod \"console-787dc45bf5-5vqzq\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.192029 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.192002 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:52.222064 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.222039 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:11:52.399902 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:52.399748 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:11:53.324708 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:53.324669 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:53.418427 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:53.418393 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:53.665994 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:53.665913 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:53.866334 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:53.866299 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:53.901744 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:53.901716 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f74775789-msxqv" Jul 03 19:11:54.036474 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:54.036398 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:54.133728 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:54.133675 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:54.670766 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:54.670685 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:54.770805 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:54.770751 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:55.172055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:55.172014 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:55.235521 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:55.235475 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:55.303789 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:55.303751 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:55.880189 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:55.880154 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:55.983222 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:55.983187 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:56.473138 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:56.473104 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c584d976b-nmsbj"] Jul 03 19:11:56.551383 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:56.551343 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" podUID="e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" containerName="registry" containerID="cri-o://c4e4e6768843fe9969f38c28844304bfa027972cf4ebedba12e51a3491972bbb" gracePeriod=30 Jul 03 19:11:56.601927 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:56.601899 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:56.702056 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:56.702016 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:56.801971 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:56.801938 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:57.848119 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:57.848095 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 19:11:58.022836 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.022760 2587 generic.go:356] "Generic (PLEG): container finished" podID="e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" containerID="c4e4e6768843fe9969f38c28844304bfa027972cf4ebedba12e51a3491972bbb" exitCode=0 Jul 03 19:11:58.023023 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.022854 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" event={"ID":"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf","Type":"ContainerDied","Data":"c4e4e6768843fe9969f38c28844304bfa027972cf4ebedba12e51a3491972bbb"} Jul 03 19:11:58.182933 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:58.182905 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc57989_30d3_4565_9068_df9bb68cf13a.slice/crio-f1a9bdd214041db1373f640b630b7fb7dd08b68c8895afc16cf42871f9d79a56 WatchSource:0}: Error finding container f1a9bdd214041db1373f640b630b7fb7dd08b68c8895afc16cf42871f9d79a56: Status 404 returned error can't find the container with id f1a9bdd214041db1373f640b630b7fb7dd08b68c8895afc16cf42871f9d79a56 Jul 03 19:11:58.214276 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.214250 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:58.310354 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.310313 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787dc45bf5-5vqzq"] Jul 03 19:11:58.334242 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.334224 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls\") pod \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " Jul 03 19:11:58.334313 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.334257 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-installation-pull-secrets\") pod \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " Jul 03 19:11:58.334313 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.334278 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-trusted-ca\") pod \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " Jul 03 19:11:58.334313 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.334309 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-bound-sa-token\") pod \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " Jul 03 19:11:58.334461 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.334350 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-certificates\") pod \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " Jul 03 19:11:58.334461 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.334381 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-image-registry-private-configuration\") pod \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " Jul 03 19:11:58.334461 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.334435 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-ca-trust-extracted\") pod \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " Jul 03 19:11:58.334612 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.334487 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwxr6\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-kube-api-access-cwxr6\") pod \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\" (UID: \"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf\") " Jul 03 19:11:58.335017 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.334764 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:11:58.335017 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.334981 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:11:58.337615 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.337589 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:11:58.337719 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.337589 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:11:58.337719 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.337669 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:11:58.337983 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.337955 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:11:58.338073 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.337988 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-kube-api-access-cwxr6" (OuterVolumeSpecName: "kube-api-access-cwxr6") pod "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf"). InnerVolumeSpecName "kube-api-access-cwxr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:11:58.344066 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.344036 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" (UID: "e7e1b673-c2d8-4f75-b7c2-ee368adc05bf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:11:58.436115 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.436039 2587 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-ca-trust-extracted\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:11:58.436115 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.436066 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwxr6\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-kube-api-access-cwxr6\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:11:58.436115 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.436076 2587 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-tls\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:11:58.436115 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.436085 2587 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-installation-pull-secrets\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:11:58.436115 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.436093 2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-trusted-ca\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:11:58.436115 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.436102 2587 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-bound-sa-token\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:11:58.436115 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.436109 2587 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-registry-certificates\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:11:58.436115 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:58.436118 2587 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf-image-registry-private-configuration\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:11:58.477169 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:11:58.477125 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31c7013_f88d_474c_95e3_c4336eb21522.slice/crio-df7309822287f7b484e9f252ee9dab2957f4c05060c3ecf8b9e7712096065136 WatchSource:0}: Error finding container df7309822287f7b484e9f252ee9dab2957f4c05060c3ecf8b9e7712096065136: Status 404 returned error can't find the container with id df7309822287f7b484e9f252ee9dab2957f4c05060c3ecf8b9e7712096065136 Jul 03 19:11:59.031586 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.031499 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" event={"ID":"857dd60a-05ec-4a42-a546-9e210c61a80e","Type":"ContainerStarted","Data":"735ca02d1c2d066472f495c5a5c8c5fb4f06d604420bc7fe21596cf506821ef1"} Jul 03 19:11:59.031586 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.031568 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" event={"ID":"857dd60a-05ec-4a42-a546-9e210c61a80e","Type":"ContainerStarted","Data":"257fba12350df0558831b3516bfc0b940c4d49c906d8b316d4645682e1947295"} Jul 03 19:11:59.032306 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.031598 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" event={"ID":"857dd60a-05ec-4a42-a546-9e210c61a80e","Type":"ContainerStarted","Data":"72333d2c6f4a3a91014b43c19f1eb6e138e8c3a500d828c9c91de660434a157e"} Jul 03 19:11:59.032689 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.032658 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerStarted","Data":"f1a9bdd214041db1373f640b630b7fb7dd08b68c8895afc16cf42871f9d79a56"} Jul 03 19:11:59.034061 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.034034 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gq4v" event={"ID":"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08","Type":"ContainerStarted","Data":"9e72ebe66d4f6c65f78d9ddc9f939526b98e655657e04d268c96cc89d0b0b5f4"} Jul 03 19:11:59.035963 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.035932 2587 generic.go:356] "Generic (PLEG): container finished" podID="08faacaf-14ab-4422-b2fd-62caa9c0f33e" containerID="1396e1ae445497232a6d4714a15326116c276539ab5af56f28e19aca73385371" exitCode=0 Jul 03 19:11:59.036089 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.036008 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pkql9" event={"ID":"08faacaf-14ab-4422-b2fd-62caa9c0f33e","Type":"ContainerDied","Data":"1396e1ae445497232a6d4714a15326116c276539ab5af56f28e19aca73385371"} Jul 03 19:11:59.038503 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.038261 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" event={"ID":"67860888-f04c-418a-82e6-c65f7fc571e7","Type":"ContainerStarted","Data":"a337ab0c889c6968ec98520e926f755b5c30c8c6d1069abbe3ad150654991df7"} Jul 03 19:11:59.039957 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.039922 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787dc45bf5-5vqzq" event={"ID":"d31c7013-f88d-474c-95e3-c4336eb21522","Type":"ContainerStarted","Data":"9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34"} Jul 03 19:11:59.040071 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.039963 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787dc45bf5-5vqzq" event={"ID":"d31c7013-f88d-474c-95e3-c4336eb21522","Type":"ContainerStarted","Data":"df7309822287f7b484e9f252ee9dab2957f4c05060c3ecf8b9e7712096065136"} Jul 03 19:11:59.041548 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.041527 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c584d976b-nmsbj" event={"ID":"997f560d-7471-4256-ab56-eb2af72162e1","Type":"ContainerStarted","Data":"032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db"} Jul 03 19:11:59.042670 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.042646 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" event={"ID":"e7e1b673-c2d8-4f75-b7c2-ee368adc05bf","Type":"ContainerDied","Data":"623173dad6b5df58c6d5753b54da04ce9167d91d47c97b7db3ef32d0fc55ee2c"} Jul 03 19:11:59.042758 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.042676 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6686459f4f-rcb5g" Jul 03 19:11:59.042758 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.042687 2587 scope.go:117] "RemoveContainer" containerID="c4e4e6768843fe9969f38c28844304bfa027972cf4ebedba12e51a3491972bbb" Jul 03 19:11:59.049054 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.049008 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-x4st8" podStartSLOduration=1.7863235880000001 podStartE2EDuration="9.048970176s" totalImagesPullingTime="7.262646588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:59.047292083 +0000 UTC m=+99.194944365" watchObservedRunningTime="2026-07-03 19:11:59.048970176 +0000 UTC m=+99.196622436" Jul 03 19:11:59.065676 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.065637 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-787dc45bf5-5vqzq" podStartSLOduration=8.065618898 podStartE2EDuration="8.065618898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:59.06419426 +0000 UTC m=+99.211846576" watchObservedRunningTime="2026-07-03 19:11:59.065618898 +0000 UTC m=+99.213271133" Jul 03 19:11:59.099227 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.099172 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c584d976b-nmsbj" podStartSLOduration=4.176303495 podStartE2EDuration="13.099150575s" totalImagesPullingTime="8.92284708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:59.083123446 +0000 UTC m=+99.230775702" watchObservedRunningTime="2026-07-03 19:11:59.099150575 +0000 UTC m=+99.246802834" Jul 03 19:11:59.122477 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.122426 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-r8zsq" podStartSLOduration=1.8996195500000002 podStartE2EDuration="9.122408833s" totalImagesPullingTime="7.222789283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:11:59.120821605 +0000 UTC m=+99.268473888" watchObservedRunningTime="2026-07-03 19:11:59.122408833 +0000 UTC m=+99.270061088" Jul 03 19:11:59.138800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.136498 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6686459f4f-rcb5g"] Jul 03 19:11:59.142602 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.142575 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6686459f4f-rcb5g"] Jul 03 19:11:59.445462 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.445422 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" path="/var/lib/kubelet/pods/e7e1b673-c2d8-4f75-b7c2-ee368adc05bf/volumes" Jul 03 19:11:59.844167 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.844139 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:11:59.944175 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:11:59.944083 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:00.048763 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:00.048730 2587 generic.go:356] "Generic (PLEG): container finished" podID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerID="02f63ddb309f8d40715e6e16f49d1d53d015cd04944fff20182c0725d283d56c" exitCode=0 Jul 03 19:12:00.049178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:00.048816 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerDied","Data":"02f63ddb309f8d40715e6e16f49d1d53d015cd04944fff20182c0725d283d56c"} Jul 03 19:12:00.050737 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:00.050709 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gq4v" event={"ID":"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08","Type":"ContainerStarted","Data":"3e3cd2630d5e4032ed60dd5b5cfc6107f579a28cb4f99ee33cfae19dc9d8d02d"} Jul 03 19:12:00.053145 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:00.053123 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pkql9" event={"ID":"08faacaf-14ab-4422-b2fd-62caa9c0f33e","Type":"ContainerStarted","Data":"ab58a65bc456079508606e861fdb7baab5c88674ef351db1aa5c55924b13c93e"} Jul 03 19:12:00.053249 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:00.053170 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pkql9" event={"ID":"08faacaf-14ab-4422-b2fd-62caa9c0f33e","Type":"ContainerStarted","Data":"a14b4f13462146ba60786076a8d8d063d22a6f66f5adbaedfb5264b023099bc1"} Jul 03 19:12:00.099465 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:00.099413 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pkql9" podStartSLOduration=2.5605566680000003 podStartE2EDuration="10.099394592s" totalImagesPullingTime="7.418085093s" totalInitContainerRuntime="120.752831ms" isStatefulPod=true podCreationTimestamp="2026-07-03 19:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:12:00.099281837 +0000 UTC m=+100.246934093" watchObservedRunningTime="2026-07-03 19:12:00.099394592 +0000 UTC m=+100.247046851" Jul 03 19:12:01.018896 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:01.018805 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:02.222564 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:02.222526 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:12:02.223026 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:02.222615 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:12:02.228660 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:02.228636 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:12:02.894103 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:02.894070 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jkr57" Jul 03 19:12:03.070317 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:03.070288 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:12:03.194502 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:03.194413 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:03.240024 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:03.239988 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:04.075510 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:04.075471 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerStarted","Data":"5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646"} Jul 03 19:12:04.075800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:04.075554 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerStarted","Data":"df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70"} Jul 03 19:12:04.075800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:04.075588 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerStarted","Data":"fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642"} Jul 03 19:12:04.075800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:04.075616 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerStarted","Data":"c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4"} Jul 03 19:12:04.075800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:04.075649 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerStarted","Data":"3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8"} Jul 03 19:12:04.077931 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:04.077902 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6gq4v" event={"ID":"79fccd49-ac9b-4b7d-be42-f7c7b7a69e08","Type":"ContainerStarted","Data":"07ea1236dfaaff6d39bfc2f95e55f56c208ef38ac95abdf492a662798b0389aa"} Jul 03 19:12:04.096348 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:04.096298 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6gq4v" podStartSLOduration=39.533466079 podStartE2EDuration="54.096283764s" totalImagesPullingTime="14.562817685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:11:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:12:04.095565276 +0000 UTC m=+104.243217535" watchObservedRunningTime="2026-07-03 19:12:04.096283764 +0000 UTC m=+104.243936059" Jul 03 19:12:04.148033 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:04.148007 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:04.531089 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:04.531058 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:04.591941 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:04.591909 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:06.088835 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:06.088801 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerStarted","Data":"c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523"} Jul 03 19:12:06.115866 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:06.115820 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.065271269 podStartE2EDuration="15.11580554s" totalImagesPullingTime="6.023335898s" totalInitContainerRuntime="27.198373ms" isStatefulPod=false podCreationTimestamp="2026-07-03 19:11:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:12:06.115520969 +0000 UTC m=+106.263173253" watchObservedRunningTime="2026-07-03 19:12:06.11580554 +0000 UTC m=+106.263457797" Jul 03 19:12:06.392101 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:06.392007 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:12:06.703841 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:06.703724 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:06.757186 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:06.757156 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:07.620455 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:07.620415 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:07.658073 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:07.658047 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-787dc45bf5-5vqzq"] Jul 03 19:12:07.720849 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:07.720817 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:07.821544 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:07.821519 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:07.880800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:07.880719 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:07.933084 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:07.933053 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:09.102690 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:09.102657 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:09.161422 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:09.161395 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:15.128645 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:15.128565 2587 generic.go:356] "Generic (PLEG): container finished" podID="e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d" containerID="89474c2d52a9d55a9f0b834646b60d0814a30ba42e060d7b1d4b9813384800a1" exitCode=0 Jul 03 19:12:15.129048 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:15.128640 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" event={"ID":"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d","Type":"ContainerDied","Data":"89474c2d52a9d55a9f0b834646b60d0814a30ba42e060d7b1d4b9813384800a1"} Jul 03 19:12:15.129048 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:15.128995 2587 scope.go:117] "RemoveContainer" containerID="89474c2d52a9d55a9f0b834646b60d0814a30ba42e060d7b1d4b9813384800a1" Jul 03 19:12:15.423830 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:15.423738 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:15.482083 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:15.482053 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:16.134598 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:16.134566 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-llvcp" event={"ID":"e5b3c431-df9f-4c7e-b96b-fa0e27ddfe3d","Type":"ContainerStarted","Data":"2e2caf5ee4a188d137d2ceef0f7f1de20b59122962b19155966b8900125b8f98"} Jul 03 19:12:24.066070 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.066005 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c584d976b-nmsbj" podUID="997f560d-7471-4256-ab56-eb2af72162e1" containerName="console" containerID="cri-o://032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db" gracePeriod=15 Jul 03 19:12:24.312015 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.311987 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:12:24.366834 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.366735 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-oauth-serving-cert\") pod \"997f560d-7471-4256-ab56-eb2af72162e1\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " Jul 03 19:12:24.366834 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.366794 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/997f560d-7471-4256-ab56-eb2af72162e1-console-serving-cert\") pod \"997f560d-7471-4256-ab56-eb2af72162e1\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " Jul 03 19:12:24.367015 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.366847 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/997f560d-7471-4256-ab56-eb2af72162e1-console-oauth-config\") pod \"997f560d-7471-4256-ab56-eb2af72162e1\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " Jul 03 19:12:24.367015 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.366964 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4crfh\" (UniqueName: \"kubernetes.io/projected/997f560d-7471-4256-ab56-eb2af72162e1-kube-api-access-4crfh\") pod \"997f560d-7471-4256-ab56-eb2af72162e1\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " Jul 03 19:12:24.367015 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.367006 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-console-config\") pod \"997f560d-7471-4256-ab56-eb2af72162e1\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " Jul 03 19:12:24.367152 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.367030 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-service-ca\") pod \"997f560d-7471-4256-ab56-eb2af72162e1\" (UID: \"997f560d-7471-4256-ab56-eb2af72162e1\") " Jul 03 19:12:24.367212 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.367159 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "997f560d-7471-4256-ab56-eb2af72162e1" (UID: "997f560d-7471-4256-ab56-eb2af72162e1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:12:24.367308 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.367287 2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-oauth-serving-cert\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:24.367425 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.367400 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-service-ca" (OuterVolumeSpecName: "service-ca") pod "997f560d-7471-4256-ab56-eb2af72162e1" (UID: "997f560d-7471-4256-ab56-eb2af72162e1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:12:24.367478 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.367422 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-console-config" (OuterVolumeSpecName: "console-config") pod "997f560d-7471-4256-ab56-eb2af72162e1" (UID: "997f560d-7471-4256-ab56-eb2af72162e1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:12:24.369171 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.369147 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/997f560d-7471-4256-ab56-eb2af72162e1-kube-api-access-4crfh" (OuterVolumeSpecName: "kube-api-access-4crfh") pod "997f560d-7471-4256-ab56-eb2af72162e1" (UID: "997f560d-7471-4256-ab56-eb2af72162e1"). InnerVolumeSpecName "kube-api-access-4crfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:12:24.369258 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.369182 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997f560d-7471-4256-ab56-eb2af72162e1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "997f560d-7471-4256-ab56-eb2af72162e1" (UID: "997f560d-7471-4256-ab56-eb2af72162e1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:12:24.369258 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.369227 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997f560d-7471-4256-ab56-eb2af72162e1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "997f560d-7471-4256-ab56-eb2af72162e1" (UID: "997f560d-7471-4256-ab56-eb2af72162e1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:12:24.468100 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.468051 2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-console-config\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:24.468100 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.468091 2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/997f560d-7471-4256-ab56-eb2af72162e1-service-ca\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:24.468100 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.468100 2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/997f560d-7471-4256-ab56-eb2af72162e1-console-serving-cert\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:24.468100 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.468110 2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/997f560d-7471-4256-ab56-eb2af72162e1-console-oauth-config\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:24.468100 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:24.468118 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4crfh\" (UniqueName: \"kubernetes.io/projected/997f560d-7471-4256-ab56-eb2af72162e1-kube-api-access-4crfh\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:25.169578 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:25.169538 2587 generic.go:356] "Generic (PLEG): container finished" podID="997f560d-7471-4256-ab56-eb2af72162e1" containerID="032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db" exitCode=0 Jul 03 19:12:25.170014 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:25.169602 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c584d976b-nmsbj" Jul 03 19:12:25.170014 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:25.169618 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c584d976b-nmsbj" event={"ID":"997f560d-7471-4256-ab56-eb2af72162e1","Type":"ContainerDied","Data":"032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db"} Jul 03 19:12:25.170014 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:25.169693 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c584d976b-nmsbj" event={"ID":"997f560d-7471-4256-ab56-eb2af72162e1","Type":"ContainerDied","Data":"4954b2e45c6366a446c2b1880afba22299d835d0b47067900bde015c5f41ca57"} Jul 03 19:12:25.170014 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:25.169713 2587 scope.go:117] "RemoveContainer" containerID="032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db" Jul 03 19:12:25.177820 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:25.177798 2587 scope.go:117] "RemoveContainer" containerID="032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db" Jul 03 19:12:25.178089 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:12:25.178069 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db\": container with ID starting with 032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db not found: ID does not exist" containerID="032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db" Jul 03 19:12:25.178174 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:25.178096 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db"} err="failed to get container status \"032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db\": rpc error: code = NotFound desc = could not find container \"032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db\": container with ID starting with 032436ce8cdc34e23dd1b5a86e4beffe2a2682f44de56fd1410247ff947870db not found: ID does not exist" Jul 03 19:12:25.189638 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:25.189617 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c584d976b-nmsbj"] Jul 03 19:12:25.192667 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:25.192649 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c584d976b-nmsbj"] Jul 03 19:12:25.444937 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:25.444860 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="997f560d-7471-4256-ab56-eb2af72162e1" path="/var/lib/kubelet/pods/997f560d-7471-4256-ab56-eb2af72162e1/volumes" Jul 03 19:12:30.190020 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:30.189986 2587 generic.go:356] "Generic (PLEG): container finished" podID="3adc0527-678e-4d7e-9f59-01913ab54679" containerID="278b0c366e5d3bf0427146178ca0df168e2ca6eab8c7ed8725dd936ed5db7956" exitCode=0 Jul 03 19:12:30.190424 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:30.190061 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" event={"ID":"3adc0527-678e-4d7e-9f59-01913ab54679","Type":"ContainerDied","Data":"278b0c366e5d3bf0427146178ca0df168e2ca6eab8c7ed8725dd936ed5db7956"} Jul 03 19:12:30.190424 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:30.190417 2587 scope.go:117] "RemoveContainer" containerID="278b0c366e5d3bf0427146178ca0df168e2ca6eab8c7ed8725dd936ed5db7956" Jul 03 19:12:30.470392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:30.470311 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:30.522667 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:30.522633 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:12:31.195052 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:31.195021 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-85l4s" event={"ID":"3adc0527-678e-4d7e-9f59-01913ab54679","Type":"ContainerStarted","Data":"d005a9affe54b7b2d65dca10db27eff08e2bb7f5df3288a9036e0ba851b7e2b7"} Jul 03 19:12:32.678286 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:32.678249 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-787dc45bf5-5vqzq" podUID="d31c7013-f88d-474c-95e3-c4336eb21522" containerName="console" containerID="cri-o://9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34" gracePeriod=15 Jul 03 19:12:32.933112 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:32.933049 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:12:33.037589 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.037561 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d31c7013-f88d-474c-95e3-c4336eb21522-console-serving-cert\") pod \"d31c7013-f88d-474c-95e3-c4336eb21522\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " Jul 03 19:12:33.037818 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.037599 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-oauth-serving-cert\") pod \"d31c7013-f88d-474c-95e3-c4336eb21522\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " Jul 03 19:12:33.037818 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.037620 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-console-config\") pod \"d31c7013-f88d-474c-95e3-c4336eb21522\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " Jul 03 19:12:33.037818 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.037663 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-trusted-ca-bundle\") pod \"d31c7013-f88d-474c-95e3-c4336eb21522\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " Jul 03 19:12:33.037818 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.037687 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4rv5\" (UniqueName: \"kubernetes.io/projected/d31c7013-f88d-474c-95e3-c4336eb21522-kube-api-access-n4rv5\") pod \"d31c7013-f88d-474c-95e3-c4336eb21522\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " Jul 03 19:12:33.037818 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.037716 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d31c7013-f88d-474c-95e3-c4336eb21522-console-oauth-config\") pod \"d31c7013-f88d-474c-95e3-c4336eb21522\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " Jul 03 19:12:33.037818 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.037747 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-service-ca\") pod \"d31c7013-f88d-474c-95e3-c4336eb21522\" (UID: \"d31c7013-f88d-474c-95e3-c4336eb21522\") " Jul 03 19:12:33.038151 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.038122 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d31c7013-f88d-474c-95e3-c4336eb21522" (UID: "d31c7013-f88d-474c-95e3-c4336eb21522"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:12:33.038208 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.038155 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-console-config" (OuterVolumeSpecName: "console-config") pod "d31c7013-f88d-474c-95e3-c4336eb21522" (UID: "d31c7013-f88d-474c-95e3-c4336eb21522"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:12:33.038270 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.038224 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d31c7013-f88d-474c-95e3-c4336eb21522" (UID: "d31c7013-f88d-474c-95e3-c4336eb21522"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:12:33.038270 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.038255 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-service-ca" (OuterVolumeSpecName: "service-ca") pod "d31c7013-f88d-474c-95e3-c4336eb21522" (UID: "d31c7013-f88d-474c-95e3-c4336eb21522"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:12:33.039999 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.039971 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d31c7013-f88d-474c-95e3-c4336eb21522-kube-api-access-n4rv5" (OuterVolumeSpecName: "kube-api-access-n4rv5") pod "d31c7013-f88d-474c-95e3-c4336eb21522" (UID: "d31c7013-f88d-474c-95e3-c4336eb21522"). InnerVolumeSpecName "kube-api-access-n4rv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:12:33.040123 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.040013 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d31c7013-f88d-474c-95e3-c4336eb21522-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d31c7013-f88d-474c-95e3-c4336eb21522" (UID: "d31c7013-f88d-474c-95e3-c4336eb21522"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:12:33.040123 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.040081 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d31c7013-f88d-474c-95e3-c4336eb21522-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d31c7013-f88d-474c-95e3-c4336eb21522" (UID: "d31c7013-f88d-474c-95e3-c4336eb21522"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:12:33.139263 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.139229 2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d31c7013-f88d-474c-95e3-c4336eb21522-console-oauth-config\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:33.139263 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.139260 2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-service-ca\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:33.139459 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.139273 2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d31c7013-f88d-474c-95e3-c4336eb21522-console-serving-cert\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:33.139459 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.139286 2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-oauth-serving-cert\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:33.139459 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.139298 2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-console-config\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:33.139459 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.139309 2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d31c7013-f88d-474c-95e3-c4336eb21522-trusted-ca-bundle\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:33.139459 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.139319 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4rv5\" (UniqueName: \"kubernetes.io/projected/d31c7013-f88d-474c-95e3-c4336eb21522-kube-api-access-n4rv5\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:12:33.203042 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.202953 2587 generic.go:356] "Generic (PLEG): container finished" podID="d31c7013-f88d-474c-95e3-c4336eb21522" containerID="9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34" exitCode=0 Jul 03 19:12:33.203042 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.203006 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787dc45bf5-5vqzq" Jul 03 19:12:33.203261 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.203035 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787dc45bf5-5vqzq" event={"ID":"d31c7013-f88d-474c-95e3-c4336eb21522","Type":"ContainerDied","Data":"9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34"} Jul 03 19:12:33.203261 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.203084 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787dc45bf5-5vqzq" event={"ID":"d31c7013-f88d-474c-95e3-c4336eb21522","Type":"ContainerDied","Data":"df7309822287f7b484e9f252ee9dab2957f4c05060c3ecf8b9e7712096065136"} Jul 03 19:12:33.203261 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.203104 2587 scope.go:117] "RemoveContainer" containerID="9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34" Jul 03 19:12:33.211892 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.211840 2587 scope.go:117] "RemoveContainer" containerID="9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34" Jul 03 19:12:33.212121 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:12:33.212099 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34\": container with ID starting with 9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34 not found: ID does not exist" containerID="9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34" Jul 03 19:12:33.212209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.212128 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34"} err="failed to get container status \"9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34\": rpc error: code = NotFound desc = could not find container \"9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34\": container with ID starting with 9fdff477ace41283e1542eae4d4014946993fdd4760c8019587769883215bb34 not found: ID does not exist" Jul 03 19:12:33.222494 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.222474 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-787dc45bf5-5vqzq"] Jul 03 19:12:33.228190 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.228171 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-787dc45bf5-5vqzq"] Jul 03 19:12:33.444678 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:12:33.444643 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d31c7013-f88d-474c-95e3-c4336eb21522" path="/var/lib/kubelet/pods/d31c7013-f88d-474c-95e3-c4336eb21522/volumes" Jul 03 19:13:09.573068 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:09.573029 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:13:09.671209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:09.671151 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:13:10.635047 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:10.635015 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 19:13:10.635475 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:10.635299 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="alertmanager" containerID="cri-o://3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8" gracePeriod=120 Jul 03 19:13:10.635475 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:10.635385 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="kube-rbac-proxy-web" containerID="cri-o://fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642" gracePeriod=120 Jul 03 19:13:10.635475 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:10.635412 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="prom-label-proxy" containerID="cri-o://c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523" gracePeriod=120 Jul 03 19:13:10.635475 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:10.635423 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="kube-rbac-proxy" containerID="cri-o://df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70" gracePeriod=120 Jul 03 19:13:10.635475 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:10.635434 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="config-reloader" containerID="cri-o://c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4" gracePeriod=120 Jul 03 19:13:10.635475 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:10.635385 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="kube-rbac-proxy-metric" containerID="cri-o://5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646" gracePeriod=120 Jul 03 19:13:11.366717 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.366669 2587 generic.go:356] "Generic (PLEG): container finished" podID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerID="c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523" exitCode=0 Jul 03 19:13:11.366717 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.366703 2587 generic.go:356] "Generic (PLEG): container finished" podID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerID="5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646" exitCode=0 Jul 03 19:13:11.366717 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.366710 2587 generic.go:356] "Generic (PLEG): container finished" podID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerID="df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70" exitCode=0 Jul 03 19:13:11.366717 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.366716 2587 generic.go:356] "Generic (PLEG): container finished" podID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerID="c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4" exitCode=0 Jul 03 19:13:11.366717 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.366723 2587 generic.go:356] "Generic (PLEG): container finished" podID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerID="3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8" exitCode=0 Jul 03 19:13:11.367035 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.366736 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerDied","Data":"c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523"} Jul 03 19:13:11.367035 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.366858 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerDied","Data":"5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646"} Jul 03 19:13:11.367035 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.366888 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerDied","Data":"df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70"} Jul 03 19:13:11.367035 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.366914 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerDied","Data":"c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4"} Jul 03 19:13:11.367035 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.366937 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerDied","Data":"3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8"} Jul 03 19:13:11.869359 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.869335 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:11.941086 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941056 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-main-tls\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941107 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941135 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-cluster-tls-config\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941174 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-web-config\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941214 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bc57989-30d3-4565-9068-df9bb68cf13a-metrics-client-ca\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941242 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy-web\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941521 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941266 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941521 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941296 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfg6m\" (UniqueName: \"kubernetes.io/projected/0bc57989-30d3-4565-9068-df9bb68cf13a-kube-api-access-sfg6m\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941521 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941337 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0bc57989-30d3-4565-9068-df9bb68cf13a-alertmanager-main-db\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941521 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941376 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bc57989-30d3-4565-9068-df9bb68cf13a-config-out\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941521 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941399 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-config-volume\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941521 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941429 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bc57989-30d3-4565-9068-df9bb68cf13a-tls-assets\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941521 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941465 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bc57989-30d3-4565-9068-df9bb68cf13a-alertmanager-trusted-ca-bundle\") pod \"0bc57989-30d3-4565-9068-df9bb68cf13a\" (UID: \"0bc57989-30d3-4565-9068-df9bb68cf13a\") " Jul 03 19:13:11.941869 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.941648 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bc57989-30d3-4565-9068-df9bb68cf13a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:11.942098 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.942068 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bc57989-30d3-4565-9068-df9bb68cf13a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:13:11.942966 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.942909 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc57989-30d3-4565-9068-df9bb68cf13a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:13:11.944501 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.944449 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc57989-30d3-4565-9068-df9bb68cf13a-config-out" (OuterVolumeSpecName: "config-out") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:13:11.944616 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.944538 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-config-volume" (OuterVolumeSpecName: "config-volume") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:11.944691 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.944657 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:11.945045 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.945003 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:11.945663 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.945629 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:11.945663 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.945647 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:11.945844 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.945796 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc57989-30d3-4565-9068-df9bb68cf13a-kube-api-access-sfg6m" (OuterVolumeSpecName: "kube-api-access-sfg6m") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "kube-api-access-sfg6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:13:11.946391 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.946363 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc57989-30d3-4565-9068-df9bb68cf13a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:13:11.950016 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.949895 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:11.957044 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:11.957021 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-web-config" (OuterVolumeSpecName: "web-config") pod "0bc57989-30d3-4565-9068-df9bb68cf13a" (UID: "0bc57989-30d3-4565-9068-df9bb68cf13a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042227 2587 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042255 2587 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-cluster-tls-config\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042266 2587 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-web-config\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042274 2587 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bc57989-30d3-4565-9068-df9bb68cf13a-metrics-client-ca\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042284 2587 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042293 2587 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042302 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfg6m\" (UniqueName: \"kubernetes.io/projected/0bc57989-30d3-4565-9068-df9bb68cf13a-kube-api-access-sfg6m\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042309 2587 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0bc57989-30d3-4565-9068-df9bb68cf13a-alertmanager-main-db\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042317 2587 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0bc57989-30d3-4565-9068-df9bb68cf13a-config-out\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042325 2587 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-config-volume\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042332 2587 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0bc57989-30d3-4565-9068-df9bb68cf13a-tls-assets\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042339 2587 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bc57989-30d3-4565-9068-df9bb68cf13a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.042340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.042347 2587 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0bc57989-30d3-4565-9068-df9bb68cf13a-secret-alertmanager-main-tls\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:13:12.373890 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.373854 2587 generic.go:356] "Generic (PLEG): container finished" podID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerID="fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642" exitCode=0 Jul 03 19:13:12.374073 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.373904 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerDied","Data":"fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642"} Jul 03 19:13:12.374073 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.373932 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.374073 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.373960 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0bc57989-30d3-4565-9068-df9bb68cf13a","Type":"ContainerDied","Data":"f1a9bdd214041db1373f640b630b7fb7dd08b68c8895afc16cf42871f9d79a56"} Jul 03 19:13:12.374073 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.373995 2587 scope.go:117] "RemoveContainer" containerID="c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523" Jul 03 19:13:12.381679 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.381520 2587 scope.go:117] "RemoveContainer" containerID="5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646" Jul 03 19:13:12.388717 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.388699 2587 scope.go:117] "RemoveContainer" containerID="df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70" Jul 03 19:13:12.395455 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.395433 2587 scope.go:117] "RemoveContainer" containerID="fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642" Jul 03 19:13:12.397913 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.397889 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 19:13:12.401066 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.401046 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 19:13:12.403252 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.403236 2587 scope.go:117] "RemoveContainer" containerID="c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4" Jul 03 19:13:12.410536 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.410517 2587 scope.go:117] "RemoveContainer" containerID="3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8" Jul 03 19:13:12.418053 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.418032 2587 scope.go:117] "RemoveContainer" containerID="02f63ddb309f8d40715e6e16f49d1d53d015cd04944fff20182c0725d283d56c" Jul 03 19:13:12.424992 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.424973 2587 scope.go:117] "RemoveContainer" containerID="c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523" Jul 03 19:13:12.425261 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:13:12.425243 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523\": container with ID starting with c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523 not found: ID does not exist" containerID="c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523" Jul 03 19:13:12.425306 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.425271 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523"} err="failed to get container status \"c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523\": rpc error: code = NotFound desc = could not find container \"c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523\": container with ID starting with c6ca4fe3180ee4aa578f31a9ce4c4117f50e571f50eecc9d704ca58d2c348523 not found: ID does not exist" Jul 03 19:13:12.425306 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.425296 2587 scope.go:117] "RemoveContainer" containerID="5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646" Jul 03 19:13:12.425538 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:13:12.425524 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646\": container with ID starting with 5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646 not found: ID does not exist" containerID="5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646" Jul 03 19:13:12.425577 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.425542 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646"} err="failed to get container status \"5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646\": rpc error: code = NotFound desc = could not find container \"5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646\": container with ID starting with 5ee35cb7aba42021e09c48e02cde9809b8b3ec1e5bee876bdf776f7c458db646 not found: ID does not exist" Jul 03 19:13:12.425577 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.425554 2587 scope.go:117] "RemoveContainer" containerID="df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70" Jul 03 19:13:12.425765 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:13:12.425746 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70\": container with ID starting with df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70 not found: ID does not exist" containerID="df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70" Jul 03 19:13:12.425830 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.425798 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70"} err="failed to get container status \"df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70\": rpc error: code = NotFound desc = could not find container \"df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70\": container with ID starting with df0ed110e09e8d00e3ff2adb2fba069fb25205321fe7ff6b4cdda1fb965e4b70 not found: ID does not exist" Jul 03 19:13:12.425830 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.425821 2587 scope.go:117] "RemoveContainer" containerID="fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642" Jul 03 19:13:12.426096 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:13:12.426079 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642\": container with ID starting with fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642 not found: ID does not exist" containerID="fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642" Jul 03 19:13:12.426163 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.426105 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642"} err="failed to get container status \"fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642\": rpc error: code = NotFound desc = could not find container \"fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642\": container with ID starting with fee1e2b498728992ee79e14de1710853f2a11ad1ac2157099f3d379e5afb4642 not found: ID does not exist" Jul 03 19:13:12.426163 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.426127 2587 scope.go:117] "RemoveContainer" containerID="c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4" Jul 03 19:13:12.426353 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:13:12.426338 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4\": container with ID starting with c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4 not found: ID does not exist" containerID="c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4" Jul 03 19:13:12.426417 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.426359 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4"} err="failed to get container status \"c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4\": rpc error: code = NotFound desc = could not find container \"c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4\": container with ID starting with c293b09b8b1a41a5ca96d6b857e329fe2f7d773a20b7a6d6589317eeab4478a4 not found: ID does not exist" Jul 03 19:13:12.426417 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.426377 2587 scope.go:117] "RemoveContainer" containerID="3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8" Jul 03 19:13:12.426586 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:13:12.426570 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8\": container with ID starting with 3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8 not found: ID does not exist" containerID="3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8" Jul 03 19:13:12.426650 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.426592 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8"} err="failed to get container status \"3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8\": rpc error: code = NotFound desc = could not find container \"3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8\": container with ID starting with 3cb280e67c12ac6ad01fba400cc9cb6a59d5179d9a644a12883a93336fa624e8 not found: ID does not exist" Jul 03 19:13:12.426650 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.426612 2587 scope.go:117] "RemoveContainer" containerID="02f63ddb309f8d40715e6e16f49d1d53d015cd04944fff20182c0725d283d56c" Jul 03 19:13:12.426899 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:13:12.426879 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f63ddb309f8d40715e6e16f49d1d53d015cd04944fff20182c0725d283d56c\": container with ID starting with 02f63ddb309f8d40715e6e16f49d1d53d015cd04944fff20182c0725d283d56c not found: ID does not exist" containerID="02f63ddb309f8d40715e6e16f49d1d53d015cd04944fff20182c0725d283d56c" Jul 03 19:13:12.426965 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.426908 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f63ddb309f8d40715e6e16f49d1d53d015cd04944fff20182c0725d283d56c"} err="failed to get container status \"02f63ddb309f8d40715e6e16f49d1d53d015cd04944fff20182c0725d283d56c\": rpc error: code = NotFound desc = could not find container \"02f63ddb309f8d40715e6e16f49d1d53d015cd04944fff20182c0725d283d56c\": container with ID starting with 02f63ddb309f8d40715e6e16f49d1d53d015cd04944fff20182c0725d283d56c not found: ID does not exist" Jul 03 19:13:12.429505 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429484 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 19:13:12.429738 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429726 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="prom-label-proxy" Jul 03 19:13:12.429799 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429740 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="prom-label-proxy" Jul 03 19:13:12.429799 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429751 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="997f560d-7471-4256-ab56-eb2af72162e1" containerName="console" Jul 03 19:13:12.429799 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429757 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="997f560d-7471-4256-ab56-eb2af72162e1" containerName="console" Jul 03 19:13:12.429799 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429766 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="kube-rbac-proxy-metric" Jul 03 19:13:12.429799 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429790 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="kube-rbac-proxy-metric" Jul 03 19:13:12.429799 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429797 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="init-config-reloader" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429802 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="init-config-reloader" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429809 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="kube-rbac-proxy" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429814 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="kube-rbac-proxy" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429820 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="config-reloader" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429826 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="config-reloader" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429834 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" containerName="registry" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429838 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" containerName="registry" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429848 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d31c7013-f88d-474c-95e3-c4336eb21522" containerName="console" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429854 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="d31c7013-f88d-474c-95e3-c4336eb21522" containerName="console" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429860 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="alertmanager" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429864 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="alertmanager" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429869 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="kube-rbac-proxy-web" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429874 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="kube-rbac-proxy-web" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429916 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="config-reloader" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429922 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="997f560d-7471-4256-ab56-eb2af72162e1" containerName="console" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429928 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="d31c7013-f88d-474c-95e3-c4336eb21522" containerName="console" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429933 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="kube-rbac-proxy" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429939 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="kube-rbac-proxy-web" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429944 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="kube-rbac-proxy-metric" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429950 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="prom-label-proxy" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429956 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" containerName="alertmanager" Jul 03 19:13:12.429981 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.429961 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e1b673-c2d8-4f75-b7c2-ee368adc05bf" containerName="registry" Jul 03 19:13:12.433250 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.433236 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.435721 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.435696 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 03 19:13:12.435721 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.435700 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 03 19:13:12.435900 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.435727 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 03 19:13:12.435900 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.435760 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fpt2k\"" Jul 03 19:13:12.435900 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.435760 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 03 19:13:12.435900 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.435808 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 03 19:13:12.436096 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.435977 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 03 19:13:12.436096 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.436089 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 03 19:13:12.436203 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.436101 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 03 19:13:12.441278 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.441260 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 03 19:13:12.445946 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.445925 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 19:13:12.547137 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547100 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cef902af-cfec-46a6-a379-d5fef96cd063-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.547137 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547144 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cef902af-cfec-46a6-a379-d5fef96cd063-config-out\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.547386 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547172 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.547386 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547220 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t5f6\" (UniqueName: \"kubernetes.io/projected/cef902af-cfec-46a6-a379-d5fef96cd063-kube-api-access-4t5f6\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.547386 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547311 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cef902af-cfec-46a6-a379-d5fef96cd063-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.547386 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547380 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.547537 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547419 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.547537 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547459 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.547537 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547494 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-web-config\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.547537 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547521 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-config-volume\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.547537 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547538 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cef902af-cfec-46a6-a379-d5fef96cd063-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.547713 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547566 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cef902af-cfec-46a6-a379-d5fef96cd063-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.547713 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.547590 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.648409 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648317 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-config-volume\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.648409 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648357 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cef902af-cfec-46a6-a379-d5fef96cd063-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.648409 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648373 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cef902af-cfec-46a6-a379-d5fef96cd063-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.648409 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648392 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.648738 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648425 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cef902af-cfec-46a6-a379-d5fef96cd063-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.648738 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648441 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cef902af-cfec-46a6-a379-d5fef96cd063-config-out\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.648738 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648629 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.648738 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648679 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t5f6\" (UniqueName: \"kubernetes.io/projected/cef902af-cfec-46a6-a379-d5fef96cd063-kube-api-access-4t5f6\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.648738 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648707 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cef902af-cfec-46a6-a379-d5fef96cd063-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.649010 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648760 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.649010 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648841 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.649010 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648896 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.649010 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.648924 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-web-config\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.649373 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.649303 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cef902af-cfec-46a6-a379-d5fef96cd063-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.649840 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.649814 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cef902af-cfec-46a6-a379-d5fef96cd063-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.650015 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.649922 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cef902af-cfec-46a6-a379-d5fef96cd063-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.651700 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.651674 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cef902af-cfec-46a6-a379-d5fef96cd063-config-out\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.651822 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.651761 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.652025 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.652004 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-web-config\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.652129 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.652089 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-config-volume\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.652188 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.652163 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.652245 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.652217 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.652245 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.652233 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cef902af-cfec-46a6-a379-d5fef96cd063-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.652578 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.652555 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.653222 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.653204 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cef902af-cfec-46a6-a379-d5fef96cd063-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.655635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.655617 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t5f6\" (UniqueName: \"kubernetes.io/projected/cef902af-cfec-46a6-a379-d5fef96cd063-kube-api-access-4t5f6\") pod \"alertmanager-main-0\" (UID: \"cef902af-cfec-46a6-a379-d5fef96cd063\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.743021 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.742986 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 19:13:12.875427 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:12.875402 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 19:13:12.877848 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:13:12.877810 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef902af_cfec_46a6_a379_d5fef96cd063.slice/crio-3d5f9aba17c79ea29543ac76a71f6301837ed99946e62e3152ffc415283bbe6e WatchSource:0}: Error finding container 3d5f9aba17c79ea29543ac76a71f6301837ed99946e62e3152ffc415283bbe6e: Status 404 returned error can't find the container with id 3d5f9aba17c79ea29543ac76a71f6301837ed99946e62e3152ffc415283bbe6e Jul 03 19:13:13.379388 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:13.379355 2587 generic.go:356] "Generic (PLEG): container finished" podID="cef902af-cfec-46a6-a379-d5fef96cd063" containerID="348d1280716acbf8661b480028b3ba1dc6ae5870da36a3e963777c6ed703a900" exitCode=0 Jul 03 19:13:13.379567 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:13.379406 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cef902af-cfec-46a6-a379-d5fef96cd063","Type":"ContainerDied","Data":"348d1280716acbf8661b480028b3ba1dc6ae5870da36a3e963777c6ed703a900"} Jul 03 19:13:13.379567 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:13.379484 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cef902af-cfec-46a6-a379-d5fef96cd063","Type":"ContainerStarted","Data":"3d5f9aba17c79ea29543ac76a71f6301837ed99946e62e3152ffc415283bbe6e"} Jul 03 19:13:13.445909 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:13.445883 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc57989-30d3-4565-9068-df9bb68cf13a" path="/var/lib/kubelet/pods/0bc57989-30d3-4565-9068-df9bb68cf13a/volumes" Jul 03 19:13:14.386193 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.386159 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cef902af-cfec-46a6-a379-d5fef96cd063","Type":"ContainerStarted","Data":"d902b4937ba142133e4fca16037e98b630ae1cf935e354324fabf242aefa59a1"} Jul 03 19:13:14.386580 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.386226 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cef902af-cfec-46a6-a379-d5fef96cd063","Type":"ContainerStarted","Data":"60c2b4d7cb3ad55441337406c1dfee6b99c512e5262c6ea9b3c05b26a2c8a260"} Jul 03 19:13:14.386580 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.386253 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cef902af-cfec-46a6-a379-d5fef96cd063","Type":"ContainerStarted","Data":"c97354a60d63dbc94fd98af52039a2a48f88513a999baba80e8e4e469191eb46"} Jul 03 19:13:14.386580 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.386277 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cef902af-cfec-46a6-a379-d5fef96cd063","Type":"ContainerStarted","Data":"994f416274f45f344098c059a41c49abf9a538d65cdc9a1f6db62d07b178d3eb"} Jul 03 19:13:14.386580 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.386301 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cef902af-cfec-46a6-a379-d5fef96cd063","Type":"ContainerStarted","Data":"be7d3b81d9c12f4081d1869ed93fc1f4f5a2724daeeec710135ab2f61a470fdb"} Jul 03 19:13:14.386580 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.386323 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cef902af-cfec-46a6-a379-d5fef96cd063","Type":"ContainerStarted","Data":"f530971bfb5fabf58f898cdc9d62deafd80a3d06a39be610a3584700475094aa"} Jul 03 19:13:14.411303 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.411241 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.394815107 podStartE2EDuration="2.411223085s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.407978ms" isStatefulPod=false podCreationTimestamp="2026-07-03 19:13:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:13:14.409143563 +0000 UTC m=+174.556795820" watchObservedRunningTime="2026-07-03 19:13:14.411223085 +0000 UTC m=+174.558875342" Jul 03 19:13:14.659069 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.658984 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6969b899b-6d42h"] Jul 03 19:13:14.664785 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.663175 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.665892 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.665868 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 03 19:13:14.666080 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.666062 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 03 19:13:14.666192 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.666105 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 03 19:13:14.666192 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.666012 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 03 19:13:14.666324 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.665879 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7nxmt\"" Jul 03 19:13:14.666567 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.666550 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 03 19:13:14.671604 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.671583 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 03 19:13:14.676186 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.676163 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6969b899b-6d42h"] Jul 03 19:13:14.766901 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.766854 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7326ca1-e9af-437b-a585-5d40f99dbdf9-metrics-client-ca\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.767093 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.766923 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7326ca1-e9af-437b-a585-5d40f99dbdf9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.767093 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.766943 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7326ca1-e9af-437b-a585-5d40f99dbdf9-serving-certs-ca-bundle\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.767093 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.766967 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7326ca1-e9af-437b-a585-5d40f99dbdf9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.767093 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.766996 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d7326ca1-e9af-437b-a585-5d40f99dbdf9-telemeter-client-tls\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.767093 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.767053 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d7326ca1-e9af-437b-a585-5d40f99dbdf9-federate-client-tls\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.767275 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.767100 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d7326ca1-e9af-437b-a585-5d40f99dbdf9-secret-telemeter-client\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.767275 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.767120 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t982b\" (UniqueName: \"kubernetes.io/projected/d7326ca1-e9af-437b-a585-5d40f99dbdf9-kube-api-access-t982b\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.868327 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.868278 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7326ca1-e9af-437b-a585-5d40f99dbdf9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.868327 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.868329 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7326ca1-e9af-437b-a585-5d40f99dbdf9-serving-certs-ca-bundle\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.868588 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.868362 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7326ca1-e9af-437b-a585-5d40f99dbdf9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.868588 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.868390 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d7326ca1-e9af-437b-a585-5d40f99dbdf9-telemeter-client-tls\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.868588 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.868433 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d7326ca1-e9af-437b-a585-5d40f99dbdf9-federate-client-tls\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.868588 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.868471 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d7326ca1-e9af-437b-a585-5d40f99dbdf9-secret-telemeter-client\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.868588 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.868497 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t982b\" (UniqueName: \"kubernetes.io/projected/d7326ca1-e9af-437b-a585-5d40f99dbdf9-kube-api-access-t982b\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.868588 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.868534 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7326ca1-e9af-437b-a585-5d40f99dbdf9-metrics-client-ca\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.869275 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.869246 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7326ca1-e9af-437b-a585-5d40f99dbdf9-metrics-client-ca\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.869405 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.869270 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7326ca1-e9af-437b-a585-5d40f99dbdf9-serving-certs-ca-bundle\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.869619 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.869599 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7326ca1-e9af-437b-a585-5d40f99dbdf9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.871154 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.871126 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d7326ca1-e9af-437b-a585-5d40f99dbdf9-secret-telemeter-client\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.871154 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.871143 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d7326ca1-e9af-437b-a585-5d40f99dbdf9-telemeter-client-tls\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.871375 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.871352 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7326ca1-e9af-437b-a585-5d40f99dbdf9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.871411 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.871399 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d7326ca1-e9af-437b-a585-5d40f99dbdf9-federate-client-tls\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.876555 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.876529 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t982b\" (UniqueName: \"kubernetes.io/projected/d7326ca1-e9af-437b-a585-5d40f99dbdf9-kube-api-access-t982b\") pod \"telemeter-client-6969b899b-6d42h\" (UID: \"d7326ca1-e9af-437b-a585-5d40f99dbdf9\") " pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:14.977365 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:14.977270 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" Jul 03 19:13:15.107870 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:15.107836 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6969b899b-6d42h"] Jul 03 19:13:15.110883 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:13:15.110851 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7326ca1_e9af_437b_a585_5d40f99dbdf9.slice/crio-71fcde7b50807c1da4b0e54a308a5687f2f4367be21e9c73851d7a2e50312f2a WatchSource:0}: Error finding container 71fcde7b50807c1da4b0e54a308a5687f2f4367be21e9c73851d7a2e50312f2a: Status 404 returned error can't find the container with id 71fcde7b50807c1da4b0e54a308a5687f2f4367be21e9c73851d7a2e50312f2a Jul 03 19:13:15.391338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:15.391304 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" event={"ID":"d7326ca1-e9af-437b-a585-5d40f99dbdf9","Type":"ContainerStarted","Data":"71fcde7b50807c1da4b0e54a308a5687f2f4367be21e9c73851d7a2e50312f2a"} Jul 03 19:13:17.402073 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:17.402032 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" event={"ID":"d7326ca1-e9af-437b-a585-5d40f99dbdf9","Type":"ContainerStarted","Data":"a5133de2c5565908ae0f8d96fb0c44d3a437eff7e4fa4f0b4b711bc106281b26"} Jul 03 19:13:17.402469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:17.402087 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" event={"ID":"d7326ca1-e9af-437b-a585-5d40f99dbdf9","Type":"ContainerStarted","Data":"e8c1ef739e8090f4d331daff767cf7b94a2cec93aed36d30d904057cecb3ebae"} Jul 03 19:13:17.402469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:17.402108 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" event={"ID":"d7326ca1-e9af-437b-a585-5d40f99dbdf9","Type":"ContainerStarted","Data":"b8063951e2ba30c09c437e80b9c075d0f462c5f94d1ee76ed3617e33695acbe6"} Jul 03 19:13:17.422852 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:17.422804 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6969b899b-6d42h" podStartSLOduration=1.769005028 podStartE2EDuration="3.422788447s" totalImagesPullingTime="1.653783419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:13:17.421207996 +0000 UTC m=+177.568860253" watchObservedRunningTime="2026-07-03 19:13:17.422788447 +0000 UTC m=+177.570440695" Jul 03 19:13:18.179348 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.179312 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-594f5db596-79vz6"] Jul 03 19:13:18.181512 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.181493 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.183826 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.183799 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 03 19:13:18.184397 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.184377 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 03 19:13:18.184498 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.184400 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 03 19:13:18.184711 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.184684 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q5m62\"" Jul 03 19:13:18.184711 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.184697 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 03 19:13:18.185480 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.185464 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 03 19:13:18.188601 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.188578 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 03 19:13:18.193900 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.193881 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594f5db596-79vz6"] Jul 03 19:13:18.299526 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.299489 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-oauth-config\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.299526 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.299528 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-serving-cert\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.299742 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.299552 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k79q2\" (UniqueName: \"kubernetes.io/projected/1f204e18-9750-40c8-833e-e3bf9c1cda15-kube-api-access-k79q2\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.299742 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.299596 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-oauth-serving-cert\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.299742 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.299620 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-trusted-ca-bundle\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.299742 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.299653 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-config\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.299742 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.299671 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-service-ca\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.304508 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.304479 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:13:18.401020 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.400975 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-oauth-config\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.401020 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.401024 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-serving-cert\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.401304 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.401048 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k79q2\" (UniqueName: \"kubernetes.io/projected/1f204e18-9750-40c8-833e-e3bf9c1cda15-kube-api-access-k79q2\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.401304 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.401072 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-oauth-serving-cert\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.401304 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.401091 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-trusted-ca-bundle\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.401304 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.401130 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-config\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.401523 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.401331 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-service-ca\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.401974 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.401952 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-oauth-serving-cert\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.402081 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.402065 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-service-ca\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.402124 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.402066 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-config\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.402389 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.402200 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-trusted-ca-bundle\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.403791 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.403758 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-oauth-config\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.403975 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.403956 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-serving-cert\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.404403 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.404383 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:13:18.408179 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.408160 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k79q2\" (UniqueName: \"kubernetes.io/projected/1f204e18-9750-40c8-833e-e3bf9c1cda15-kube-api-access-k79q2\") pod \"console-594f5db596-79vz6\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.491152 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.491063 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:18.505243 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.505214 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:13:18.619683 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.619559 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594f5db596-79vz6"] Jul 03 19:13:18.622362 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:13:18.622335 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f204e18_9750_40c8_833e_e3bf9c1cda15.slice/crio-dfcefd5ec067c4175ebe38fc5be76a13d522d1bda52f5015b5fde7d76c1ebb6f WatchSource:0}: Error finding container dfcefd5ec067c4175ebe38fc5be76a13d522d1bda52f5015b5fde7d76c1ebb6f: Status 404 returned error can't find the container with id dfcefd5ec067c4175ebe38fc5be76a13d522d1bda52f5015b5fde7d76c1ebb6f Jul 03 19:13:18.976782 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:18.976730 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:13:19.026626 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:19.026601 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:13:19.411544 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:19.411514 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594f5db596-79vz6" event={"ID":"1f204e18-9750-40c8-833e-e3bf9c1cda15","Type":"ContainerStarted","Data":"07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319"} Jul 03 19:13:19.411928 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:19.411565 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594f5db596-79vz6" event={"ID":"1f204e18-9750-40c8-833e-e3bf9c1cda15","Type":"ContainerStarted","Data":"dfcefd5ec067c4175ebe38fc5be76a13d522d1bda52f5015b5fde7d76c1ebb6f"} Jul 03 19:13:19.432008 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:19.431965 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-594f5db596-79vz6" podStartSLOduration=1.431950429 podStartE2EDuration="1.431950429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:13:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:13:19.430720705 +0000 UTC m=+179.578372965" watchObservedRunningTime="2026-07-03 19:13:19.431950429 +0000 UTC m=+179.579602687" Jul 03 19:13:28.491180 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:28.491147 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:28.491585 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:28.491229 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:28.495905 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:28.495881 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:29.454422 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:29.454394 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:13:29.612936 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:29.612900 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:13:29.713476 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:13:29.713389 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:05.417288 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:05.417256 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:19.681699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:19.681658 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:24.789088 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:24.789054 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:24.837926 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:24.837888 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:26.859329 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:26.859274 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5b499b46-9n97k"] Jul 03 19:14:26.862857 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:26.862834 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:26.872903 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:26.872880 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5b499b46-9n97k"] Jul 03 19:14:26.907990 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:26.907960 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:26.960550 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:26.960516 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:26.968741 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:26.968717 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-oauth-config\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:26.968838 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:26.968746 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-serving-cert\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:26.968838 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:26.968767 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-config\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:26.968838 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:26.968798 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f8l8\" (UniqueName: \"kubernetes.io/projected/06c8cae4-4ce4-4002-b116-91357c25d5dc-kube-api-access-4f8l8\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:26.968838 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:26.968830 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-oauth-serving-cert\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:26.968983 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:26.968889 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-trusted-ca-bundle\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:26.968983 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:26.968905 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-service-ca\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.046614 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.046569 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:27.070232 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.070202 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-trusted-ca-bundle\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.070408 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.070236 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-service-ca\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.070408 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.070289 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-oauth-config\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.070408 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.070319 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-serving-cert\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.070408 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.070357 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-config\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.070408 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.070378 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f8l8\" (UniqueName: \"kubernetes.io/projected/06c8cae4-4ce4-4002-b116-91357c25d5dc-kube-api-access-4f8l8\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.070657 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.070418 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-oauth-serving-cert\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.071156 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.071128 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-service-ca\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.071317 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.071292 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-oauth-serving-cert\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.071317 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.071167 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-config\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.071482 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.071240 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-trusted-ca-bundle\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.072974 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.072956 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-oauth-config\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.073074 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.073059 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-serving-cert\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.078365 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.078343 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f8l8\" (UniqueName: \"kubernetes.io/projected/06c8cae4-4ce4-4002-b116-91357c25d5dc-kube-api-access-4f8l8\") pod \"console-7f5b499b46-9n97k\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.099450 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.099420 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:27.172847 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.172740 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:27.300198 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.300174 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5b499b46-9n97k"] Jul 03 19:14:27.302570 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:14:27.302545 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c8cae4_4ce4_4002_b116_91357c25d5dc.slice/crio-125bc550df235067ae83a3ec7c762d7c6dad57d90b77c0025ff15dc90396f6d6 WatchSource:0}: Error finding container 125bc550df235067ae83a3ec7c762d7c6dad57d90b77c0025ff15dc90396f6d6: Status 404 returned error can't find the container with id 125bc550df235067ae83a3ec7c762d7c6dad57d90b77c0025ff15dc90396f6d6 Jul 03 19:14:27.653904 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.653870 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:27.676271 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.676241 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5b499b46-9n97k" event={"ID":"06c8cae4-4ce4-4002-b116-91357c25d5dc","Type":"ContainerStarted","Data":"72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6"} Jul 03 19:14:27.676411 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.676284 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5b499b46-9n97k" event={"ID":"06c8cae4-4ce4-4002-b116-91357c25d5dc","Type":"ContainerStarted","Data":"125bc550df235067ae83a3ec7c762d7c6dad57d90b77c0025ff15dc90396f6d6"} Jul 03 19:14:27.691998 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.691948 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f5b499b46-9n97k" podStartSLOduration=1.691929425 podStartE2EDuration="1.691929425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:14:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:14:27.691020557 +0000 UTC m=+247.838672843" watchObservedRunningTime="2026-07-03 19:14:27.691929425 +0000 UTC m=+247.839581684" Jul 03 19:14:27.753471 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:27.753443 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:36.587545 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:36.587510 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:36.638172 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:36.638146 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:37.173156 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:37.173128 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:37.173324 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:37.173180 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:37.177935 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:37.177910 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:37.719202 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:37.719174 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:14:37.763367 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:37.763334 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594f5db596-79vz6"] Jul 03 19:14:37.863470 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:37.863444 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:37.973979 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:37.973905 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:38.021026 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:38.020996 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:45.436179 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:45.436093 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:45.535184 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:45.535153 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:14:45.591091 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:14:45.591064 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:15:02.784956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:02.784897 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-594f5db596-79vz6" podUID="1f204e18-9750-40c8-833e-e3bf9c1cda15" containerName="console" containerID="cri-o://07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319" gracePeriod=15 Jul 03 19:15:03.030361 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.030339 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:15:03.167011 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.166978 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-service-ca\") pod \"1f204e18-9750-40c8-833e-e3bf9c1cda15\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " Jul 03 19:15:03.167011 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.167016 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-oauth-config\") pod \"1f204e18-9750-40c8-833e-e3bf9c1cda15\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " Jul 03 19:15:03.167244 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.167057 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-serving-cert\") pod \"1f204e18-9750-40c8-833e-e3bf9c1cda15\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " Jul 03 19:15:03.167244 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.167082 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-oauth-serving-cert\") pod \"1f204e18-9750-40c8-833e-e3bf9c1cda15\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " Jul 03 19:15:03.167244 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.167102 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-trusted-ca-bundle\") pod \"1f204e18-9750-40c8-833e-e3bf9c1cda15\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " Jul 03 19:15:03.167244 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.167128 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k79q2\" (UniqueName: \"kubernetes.io/projected/1f204e18-9750-40c8-833e-e3bf9c1cda15-kube-api-access-k79q2\") pod \"1f204e18-9750-40c8-833e-e3bf9c1cda15\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " Jul 03 19:15:03.167244 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.167163 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-config\") pod \"1f204e18-9750-40c8-833e-e3bf9c1cda15\" (UID: \"1f204e18-9750-40c8-833e-e3bf9c1cda15\") " Jul 03 19:15:03.167500 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.167435 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f204e18-9750-40c8-833e-e3bf9c1cda15" (UID: "1f204e18-9750-40c8-833e-e3bf9c1cda15"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:15:03.167591 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.167547 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f204e18-9750-40c8-833e-e3bf9c1cda15" (UID: "1f204e18-9750-40c8-833e-e3bf9c1cda15"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:15:03.167647 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.167569 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f204e18-9750-40c8-833e-e3bf9c1cda15" (UID: "1f204e18-9750-40c8-833e-e3bf9c1cda15"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:15:03.167687 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.167659 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-config" (OuterVolumeSpecName: "console-config") pod "1f204e18-9750-40c8-833e-e3bf9c1cda15" (UID: "1f204e18-9750-40c8-833e-e3bf9c1cda15"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:15:03.169292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.169267 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f204e18-9750-40c8-833e-e3bf9c1cda15-kube-api-access-k79q2" (OuterVolumeSpecName: "kube-api-access-k79q2") pod "1f204e18-9750-40c8-833e-e3bf9c1cda15" (UID: "1f204e18-9750-40c8-833e-e3bf9c1cda15"). InnerVolumeSpecName "kube-api-access-k79q2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:15:03.169377 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.169321 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f204e18-9750-40c8-833e-e3bf9c1cda15" (UID: "1f204e18-9750-40c8-833e-e3bf9c1cda15"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:15:03.169377 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.169338 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f204e18-9750-40c8-833e-e3bf9c1cda15" (UID: "1f204e18-9750-40c8-833e-e3bf9c1cda15"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:15:03.267726 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.267693 2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-service-ca\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:15:03.267726 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.267720 2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-oauth-config\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:15:03.267726 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.267731 2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-serving-cert\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:15:03.267990 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.267740 2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-oauth-serving-cert\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:15:03.267990 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.267749 2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-trusted-ca-bundle\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:15:03.267990 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.267757 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k79q2\" (UniqueName: \"kubernetes.io/projected/1f204e18-9750-40c8-833e-e3bf9c1cda15-kube-api-access-k79q2\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:15:03.267990 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.267765 2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f204e18-9750-40c8-833e-e3bf9c1cda15-console-config\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:15:03.821144 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.821113 2587 generic.go:356] "Generic (PLEG): container finished" podID="1f204e18-9750-40c8-833e-e3bf9c1cda15" containerID="07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319" exitCode=0 Jul 03 19:15:03.821529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.821162 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594f5db596-79vz6" Jul 03 19:15:03.821529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.821168 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594f5db596-79vz6" event={"ID":"1f204e18-9750-40c8-833e-e3bf9c1cda15","Type":"ContainerDied","Data":"07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319"} Jul 03 19:15:03.821529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.821236 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594f5db596-79vz6" event={"ID":"1f204e18-9750-40c8-833e-e3bf9c1cda15","Type":"ContainerDied","Data":"dfcefd5ec067c4175ebe38fc5be76a13d522d1bda52f5015b5fde7d76c1ebb6f"} Jul 03 19:15:03.821529 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.821257 2587 scope.go:117] "RemoveContainer" containerID="07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319" Jul 03 19:15:03.829072 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.829055 2587 scope.go:117] "RemoveContainer" containerID="07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319" Jul 03 19:15:03.829318 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:15:03.829298 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319\": container with ID starting with 07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319 not found: ID does not exist" containerID="07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319" Jul 03 19:15:03.829368 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.829323 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319"} err="failed to get container status \"07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319\": rpc error: code = NotFound desc = could not find container \"07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319\": container with ID starting with 07342916f3b8da3d7dba9c30977c203cf199a909dc906fed79d1c07d2b404319 not found: ID does not exist" Jul 03 19:15:03.836795 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.836753 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594f5db596-79vz6"] Jul 03 19:15:03.840094 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:03.840074 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-594f5db596-79vz6"] Jul 03 19:15:05.444962 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:05.444935 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f204e18-9750-40c8-833e-e3bf9c1cda15" path="/var/lib/kubelet/pods/1f204e18-9750-40c8-833e-e3bf9c1cda15/volumes" Jul 03 19:15:20.249309 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:20.249287 2587 kubelet.go:1648] "Image garbage collection succeeded" Jul 03 19:15:28.679270 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:28.679238 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:15:28.776831 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:28.776800 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:15:50.219537 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:50.219501 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:15:51.381514 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:51.381483 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:15:53.816538 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:53.816504 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:15:53.875728 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:53.875690 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:15:55.623242 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:55.623202 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:15:55.731958 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:55.731926 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:15:55.845388 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:55.845354 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:15:56.055443 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.055404 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7tdzb"] Jul 03 19:15:56.055829 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.055813 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f204e18-9750-40c8-833e-e3bf9c1cda15" containerName="console" Jul 03 19:15:56.055922 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.055832 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f204e18-9750-40c8-833e-e3bf9c1cda15" containerName="console" Jul 03 19:15:56.055922 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.055907 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f204e18-9750-40c8-833e-e3bf9c1cda15" containerName="console" Jul 03 19:15:56.058805 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.058764 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" Jul 03 19:15:56.061019 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.060997 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 03 19:15:56.061716 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.061698 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 03 19:15:56.061830 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.061698 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7wf45\"" Jul 03 19:15:56.068500 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.068481 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7tdzb"] Jul 03 19:15:56.090456 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.090428 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbbf3b83-74c9-4c32-8cf6-2b8b905a777c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7tdzb\" (UID: \"dbbf3b83-74c9-4c32-8cf6-2b8b905a777c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" Jul 03 19:15:56.090574 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.090466 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nj8l\" (UniqueName: \"kubernetes.io/projected/dbbf3b83-74c9-4c32-8cf6-2b8b905a777c-kube-api-access-4nj8l\") pod \"cert-manager-webhook-6486ffd997-7tdzb\" (UID: \"dbbf3b83-74c9-4c32-8cf6-2b8b905a777c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" Jul 03 19:15:56.191048 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.191016 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nj8l\" (UniqueName: \"kubernetes.io/projected/dbbf3b83-74c9-4c32-8cf6-2b8b905a777c-kube-api-access-4nj8l\") pod \"cert-manager-webhook-6486ffd997-7tdzb\" (UID: \"dbbf3b83-74c9-4c32-8cf6-2b8b905a777c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" Jul 03 19:15:56.191216 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.191090 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbbf3b83-74c9-4c32-8cf6-2b8b905a777c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7tdzb\" (UID: \"dbbf3b83-74c9-4c32-8cf6-2b8b905a777c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" Jul 03 19:15:56.198681 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.198646 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dbbf3b83-74c9-4c32-8cf6-2b8b905a777c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7tdzb\" (UID: \"dbbf3b83-74c9-4c32-8cf6-2b8b905a777c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" Jul 03 19:15:56.198821 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.198763 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nj8l\" (UniqueName: \"kubernetes.io/projected/dbbf3b83-74c9-4c32-8cf6-2b8b905a777c-kube-api-access-4nj8l\") pod \"cert-manager-webhook-6486ffd997-7tdzb\" (UID: \"dbbf3b83-74c9-4c32-8cf6-2b8b905a777c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" Jul 03 19:15:56.367651 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.367556 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" Jul 03 19:15:56.496457 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.496426 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7tdzb"] Jul 03 19:15:56.499486 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:15:56.499463 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbbf3b83_74c9_4c32_8cf6_2b8b905a777c.slice/crio-4977a85e7ed2a55d6cfb96e36fcd51e18f3685fabf280e71f93d6829c2ddd482 WatchSource:0}: Error finding container 4977a85e7ed2a55d6cfb96e36fcd51e18f3685fabf280e71f93d6829c2ddd482: Status 404 returned error can't find the container with id 4977a85e7ed2a55d6cfb96e36fcd51e18f3685fabf280e71f93d6829c2ddd482 Jul 03 19:15:56.501485 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:56.501471 2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 19:15:57.020508 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:57.020471 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" event={"ID":"dbbf3b83-74c9-4c32-8cf6-2b8b905a777c","Type":"ContainerStarted","Data":"4977a85e7ed2a55d6cfb96e36fcd51e18f3685fabf280e71f93d6829c2ddd482"} Jul 03 19:15:58.076594 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:58.076498 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:15:58.259681 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:15:58.259646 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:00.037276 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:00.037217 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" event={"ID":"dbbf3b83-74c9-4c32-8cf6-2b8b905a777c","Type":"ContainerStarted","Data":"c15226a6b7131df17ba4664cbc581e5e2ada5b319da86130e873e56f9d974119"} Jul 03 19:16:00.037728 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:00.037301 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" Jul 03 19:16:00.053377 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:00.053327 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" podStartSLOduration=0.606441401 podStartE2EDuration="4.053305403s" totalImagesPullingTime="3.446864002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:00.052010323 +0000 UTC m=+340.199662582" watchObservedRunningTime="2026-07-03 19:16:00.053305403 +0000 UTC m=+340.200957661" Jul 03 19:16:00.825180 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:00.825148 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:00.924827 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:00.924795 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:05.666450 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:05.666409 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:06.044636 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:06.044608 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7tdzb" Jul 03 19:16:06.083017 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:06.082932 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:06.144071 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:06.144039 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:06.838068 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:06.838039 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:06.938639 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:06.938606 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:09.082910 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.082877 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc"] Jul 03 19:16:09.086219 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.086202 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc" Jul 03 19:16:09.088267 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.088248 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 03 19:16:09.088389 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.088347 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wrkcz\"" Jul 03 19:16:09.089096 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.089078 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 03 19:16:09.093436 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.093266 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc"] Jul 03 19:16:09.205436 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.205395 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjcmh\" (UniqueName: \"kubernetes.io/projected/dcbfb72a-0620-4301-ba23-e06c9aa4e254-kube-api-access-fjcmh\") pod \"openshift-lws-operator-fd8ccff4c-xsthc\" (UID: \"dcbfb72a-0620-4301-ba23-e06c9aa4e254\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc" Jul 03 19:16:09.205601 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.205444 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcbfb72a-0620-4301-ba23-e06c9aa4e254-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xsthc\" (UID: \"dcbfb72a-0620-4301-ba23-e06c9aa4e254\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc" Jul 03 19:16:09.306846 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.306806 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcmh\" (UniqueName: \"kubernetes.io/projected/dcbfb72a-0620-4301-ba23-e06c9aa4e254-kube-api-access-fjcmh\") pod \"openshift-lws-operator-fd8ccff4c-xsthc\" (UID: \"dcbfb72a-0620-4301-ba23-e06c9aa4e254\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc" Jul 03 19:16:09.307036 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.306858 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcbfb72a-0620-4301-ba23-e06c9aa4e254-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xsthc\" (UID: \"dcbfb72a-0620-4301-ba23-e06c9aa4e254\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc" Jul 03 19:16:09.307244 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.307222 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcbfb72a-0620-4301-ba23-e06c9aa4e254-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xsthc\" (UID: \"dcbfb72a-0620-4301-ba23-e06c9aa4e254\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc" Jul 03 19:16:09.314365 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.314341 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjcmh\" (UniqueName: \"kubernetes.io/projected/dcbfb72a-0620-4301-ba23-e06c9aa4e254-kube-api-access-fjcmh\") pod \"openshift-lws-operator-fd8ccff4c-xsthc\" (UID: \"dcbfb72a-0620-4301-ba23-e06c9aa4e254\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc" Jul 03 19:16:09.396350 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.396260 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc" Jul 03 19:16:09.523641 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:09.523500 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc"] Jul 03 19:16:09.526446 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:16:09.526408 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcbfb72a_0620_4301_ba23_e06c9aa4e254.slice/crio-1988270583d13b41ad9bd5e209b83ed04c2c1c6500b9474b1312f5f55eeba77d WatchSource:0}: Error finding container 1988270583d13b41ad9bd5e209b83ed04c2c1c6500b9474b1312f5f55eeba77d: Status 404 returned error can't find the container with id 1988270583d13b41ad9bd5e209b83ed04c2c1c6500b9474b1312f5f55eeba77d Jul 03 19:16:10.083856 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:10.083821 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc" event={"ID":"dcbfb72a-0620-4301-ba23-e06c9aa4e254","Type":"ContainerStarted","Data":"1988270583d13b41ad9bd5e209b83ed04c2c1c6500b9474b1312f5f55eeba77d"} Jul 03 19:16:14.103584 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:14.103550 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc" event={"ID":"dcbfb72a-0620-4301-ba23-e06c9aa4e254","Type":"ContainerStarted","Data":"49d1e1712ca8ca3f4ff0d7c58980947ef53170d1d24fd6be710afada8cfa198d"} Jul 03 19:16:14.118544 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:14.118497 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xsthc" podStartSLOduration=0.888414099 podStartE2EDuration="5.118482069s" totalImagesPullingTime="4.23006797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:14.117835375 +0000 UTC m=+354.265487633" watchObservedRunningTime="2026-07-03 19:16:14.118482069 +0000 UTC m=+354.266134327" Jul 03 19:16:14.744010 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:14.743980 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:14.846889 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:14.846856 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:16.768975 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:16.768941 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:29.431280 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:29.431246 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:29.528635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:29.528599 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:30.038353 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.038316 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:30.260956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.260925 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:30.361338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.361308 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:30.394788 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.394753 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx"] Jul 03 19:16:30.398229 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.398211 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.400586 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.400566 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 03 19:16:30.400691 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.400640 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-km28h\"" Jul 03 19:16:30.400814 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.400798 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 03 19:16:30.401017 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.401002 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 03 19:16:30.401084 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.401062 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 03 19:16:30.423870 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.423833 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx"] Jul 03 19:16:30.584785 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.584746 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c0fa91f8-3f13-4588-b51e-7a83d897260b-manifests\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.585246 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.584815 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcbhg\" (UniqueName: \"kubernetes.io/projected/c0fa91f8-3f13-4588-b51e-7a83d897260b-kube-api-access-vcbhg\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.585246 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.584845 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0fa91f8-3f13-4588-b51e-7a83d897260b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.585246 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.584864 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0fa91f8-3f13-4588-b51e-7a83d897260b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.585246 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.584951 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0fa91f8-3f13-4588-b51e-7a83d897260b-tmp\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.594042 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.594015 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:30.686340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.686238 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0fa91f8-3f13-4588-b51e-7a83d897260b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.686340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.686287 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0fa91f8-3f13-4588-b51e-7a83d897260b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.686340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.686341 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0fa91f8-3f13-4588-b51e-7a83d897260b-tmp\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.686622 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.686417 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c0fa91f8-3f13-4588-b51e-7a83d897260b-manifests\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.686622 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.686444 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcbhg\" (UniqueName: \"kubernetes.io/projected/c0fa91f8-3f13-4588-b51e-7a83d897260b-kube-api-access-vcbhg\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.686853 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.686825 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c0fa91f8-3f13-4588-b51e-7a83d897260b-manifests\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.688590 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.688563 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0fa91f8-3f13-4588-b51e-7a83d897260b-tmp\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.688828 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.688808 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c0fa91f8-3f13-4588-b51e-7a83d897260b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.688900 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.688878 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c0fa91f8-3f13-4588-b51e-7a83d897260b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.695089 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.695060 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:30.697376 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.697355 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcbhg\" (UniqueName: \"kubernetes.io/projected/c0fa91f8-3f13-4588-b51e-7a83d897260b-kube-api-access-vcbhg\") pod \"opendatahub-operator-controller-manager-5db468f498-sqhmx\" (UID: \"c0fa91f8-3f13-4588-b51e-7a83d897260b\") " pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.709348 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.709322 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:30.794342 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.794313 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:30.844439 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.844405 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx"] Jul 03 19:16:30.847797 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:16:30.847748 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0fa91f8_3f13_4588_b51e_7a83d897260b.slice/crio-951f25bf33d64cbd309fe6b55150ba64f4a754db7cb45e849cc708e6481f7091 WatchSource:0}: Error finding container 951f25bf33d64cbd309fe6b55150ba64f4a754db7cb45e849cc708e6481f7091: Status 404 returned error can't find the container with id 951f25bf33d64cbd309fe6b55150ba64f4a754db7cb45e849cc708e6481f7091 Jul 03 19:16:30.856636 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.856612 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:30.944206 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:30.944101 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:31.049591 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:31.049562 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:31.140561 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:31.140516 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:31.172487 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:31.172456 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" event={"ID":"c0fa91f8-3f13-4588-b51e-7a83d897260b","Type":"ContainerStarted","Data":"951f25bf33d64cbd309fe6b55150ba64f4a754db7cb45e849cc708e6481f7091"} Jul 03 19:16:34.189698 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:34.189655 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" event={"ID":"c0fa91f8-3f13-4588-b51e-7a83d897260b","Type":"ContainerStarted","Data":"4c9d992eab082a9129e9e04563696f22d354b87df8c5dbfbb92ace0ca60f37e7"} Jul 03 19:16:35.195906 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:35.195870 2587 generic.go:356] "Generic (PLEG): container finished" podID="c0fa91f8-3f13-4588-b51e-7a83d897260b" containerID="4c9d992eab082a9129e9e04563696f22d354b87df8c5dbfbb92ace0ca60f37e7" exitCode=0 Jul 03 19:16:35.196287 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:35.195946 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" event={"ID":"c0fa91f8-3f13-4588-b51e-7a83d897260b","Type":"ContainerDied","Data":"4c9d992eab082a9129e9e04563696f22d354b87df8c5dbfbb92ace0ca60f37e7"} Jul 03 19:16:36.202340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:36.202306 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" event={"ID":"c0fa91f8-3f13-4588-b51e-7a83d897260b","Type":"ContainerStarted","Data":"a91d9bb626347c484eda35f1c7c0bc3d2d825a6c8f55fdb023c1ba7119edb0ba"} Jul 03 19:16:36.202760 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:36.202429 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:36.222636 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:36.222583 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" podStartSLOduration=1.677410413 podStartE2EDuration="6.22256348s" totalImagesPullingTime="3.521026291s" totalInitContainerRuntime="1.024126776s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:36.22103837 +0000 UTC m=+376.368690651" watchObservedRunningTime="2026-07-03 19:16:36.22256348 +0000 UTC m=+376.370215738" Jul 03 19:16:41.035591 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:41.035555 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:41.161643 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:41.161612 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:41.628452 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:41.628426 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:41.728223 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:41.728195 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:47.208398 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:47.208364 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5db468f498-sqhmx" Jul 03 19:16:49.187916 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.187877 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:49.356762 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.356719 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:49.680808 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.680752 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:49.799508 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.799476 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:49.888223 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.888193 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:49.943717 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.943637 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-994f4989b-9hntc"] Jul 03 19:16:49.948318 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.948299 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" Jul 03 19:16:49.951722 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.951695 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 03 19:16:49.951869 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.951745 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 03 19:16:49.951954 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.951695 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lwfxl\"" Jul 03 19:16:49.952051 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.952030 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 03 19:16:49.952176 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.952094 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 03 19:16:49.959145 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:49.959122 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-994f4989b-9hntc"] Jul 03 19:16:50.044459 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.044426 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqnht\" (UniqueName: \"kubernetes.io/projected/9a829d83-4443-450c-87cc-f7f1ce2d6771-kube-api-access-fqnht\") pod \"kube-auth-proxy-994f4989b-9hntc\" (UID: \"9a829d83-4443-450c-87cc-f7f1ce2d6771\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" Jul 03 19:16:50.044662 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.044474 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a829d83-4443-450c-87cc-f7f1ce2d6771-tmp\") pod \"kube-auth-proxy-994f4989b-9hntc\" (UID: \"9a829d83-4443-450c-87cc-f7f1ce2d6771\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" Jul 03 19:16:50.044662 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.044550 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a829d83-4443-450c-87cc-f7f1ce2d6771-tls-certs\") pod \"kube-auth-proxy-994f4989b-9hntc\" (UID: \"9a829d83-4443-450c-87cc-f7f1ce2d6771\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" Jul 03 19:16:50.104603 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.104534 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-d4vbc"] Jul 03 19:16:50.106858 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.106837 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" Jul 03 19:16:50.109165 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.109145 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 03 19:16:50.109271 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.109179 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qx95l\"" Jul 03 19:16:50.117409 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.117388 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-d4vbc"] Jul 03 19:16:50.145339 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.145304 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6068d3-d38e-4af8-bc7b-86bb44554ce6-cert\") pod \"odh-model-controller-7998c67dc4-d4vbc\" (UID: \"8f6068d3-d38e-4af8-bc7b-86bb44554ce6\") " pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" Jul 03 19:16:50.145497 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.145359 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvwz\" (UniqueName: \"kubernetes.io/projected/8f6068d3-d38e-4af8-bc7b-86bb44554ce6-kube-api-access-lqvwz\") pod \"odh-model-controller-7998c67dc4-d4vbc\" (UID: \"8f6068d3-d38e-4af8-bc7b-86bb44554ce6\") " pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" Jul 03 19:16:50.145497 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.145472 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqnht\" (UniqueName: \"kubernetes.io/projected/9a829d83-4443-450c-87cc-f7f1ce2d6771-kube-api-access-fqnht\") pod \"kube-auth-proxy-994f4989b-9hntc\" (UID: \"9a829d83-4443-450c-87cc-f7f1ce2d6771\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" Jul 03 19:16:50.145628 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.145527 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a829d83-4443-450c-87cc-f7f1ce2d6771-tmp\") pod \"kube-auth-proxy-994f4989b-9hntc\" (UID: \"9a829d83-4443-450c-87cc-f7f1ce2d6771\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" Jul 03 19:16:50.145628 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.145578 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a829d83-4443-450c-87cc-f7f1ce2d6771-tls-certs\") pod \"kube-auth-proxy-994f4989b-9hntc\" (UID: \"9a829d83-4443-450c-87cc-f7f1ce2d6771\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" Jul 03 19:16:50.147719 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.147694 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a829d83-4443-450c-87cc-f7f1ce2d6771-tmp\") pod \"kube-auth-proxy-994f4989b-9hntc\" (UID: \"9a829d83-4443-450c-87cc-f7f1ce2d6771\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" Jul 03 19:16:50.148046 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.148027 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a829d83-4443-450c-87cc-f7f1ce2d6771-tls-certs\") pod \"kube-auth-proxy-994f4989b-9hntc\" (UID: \"9a829d83-4443-450c-87cc-f7f1ce2d6771\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" Jul 03 19:16:50.157483 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.157456 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:50.160522 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.160502 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqnht\" (UniqueName: \"kubernetes.io/projected/9a829d83-4443-450c-87cc-f7f1ce2d6771-kube-api-access-fqnht\") pod \"kube-auth-proxy-994f4989b-9hntc\" (UID: \"9a829d83-4443-450c-87cc-f7f1ce2d6771\") " pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" Jul 03 19:16:50.247094 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.247008 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6068d3-d38e-4af8-bc7b-86bb44554ce6-cert\") pod \"odh-model-controller-7998c67dc4-d4vbc\" (UID: \"8f6068d3-d38e-4af8-bc7b-86bb44554ce6\") " pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" Jul 03 19:16:50.247094 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.247055 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvwz\" (UniqueName: \"kubernetes.io/projected/8f6068d3-d38e-4af8-bc7b-86bb44554ce6-kube-api-access-lqvwz\") pod \"odh-model-controller-7998c67dc4-d4vbc\" (UID: \"8f6068d3-d38e-4af8-bc7b-86bb44554ce6\") " pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" Jul 03 19:16:50.247526 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:16:50.247163 2587 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 03 19:16:50.247526 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:16:50.247252 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f6068d3-d38e-4af8-bc7b-86bb44554ce6-cert podName:8f6068d3-d38e-4af8-bc7b-86bb44554ce6 nodeName:}" failed. No retries permitted until 2026-07-03 19:16:50.747229158 +0000 UTC m=+390.894881410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f6068d3-d38e-4af8-bc7b-86bb44554ce6-cert") pod "odh-model-controller-7998c67dc4-d4vbc" (UID: "8f6068d3-d38e-4af8-bc7b-86bb44554ce6") : secret "odh-model-controller-webhook-cert" not found Jul 03 19:16:50.259951 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.259912 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" Jul 03 19:16:50.271649 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.271622 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:50.274919 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.274565 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvwz\" (UniqueName: \"kubernetes.io/projected/8f6068d3-d38e-4af8-bc7b-86bb44554ce6-kube-api-access-lqvwz\") pod \"odh-model-controller-7998c67dc4-d4vbc\" (UID: \"8f6068d3-d38e-4af8-bc7b-86bb44554ce6\") " pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" Jul 03 19:16:50.376107 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.376061 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:50.415055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.415022 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-994f4989b-9hntc"] Jul 03 19:16:50.418185 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:16:50.418159 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a829d83_4443_450c_87cc_f7f1ce2d6771.slice/crio-69a82161f3a9019c1741bc1a910a8f7024304df2f20578dcfbc2ca1139cad5d1 WatchSource:0}: Error finding container 69a82161f3a9019c1741bc1a910a8f7024304df2f20578dcfbc2ca1139cad5d1: Status 404 returned error can't find the container with id 69a82161f3a9019c1741bc1a910a8f7024304df2f20578dcfbc2ca1139cad5d1 Jul 03 19:16:50.715534 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.715499 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:50.752021 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.751981 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6068d3-d38e-4af8-bc7b-86bb44554ce6-cert\") pod \"odh-model-controller-7998c67dc4-d4vbc\" (UID: \"8f6068d3-d38e-4af8-bc7b-86bb44554ce6\") " pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" Jul 03 19:16:50.754477 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.754452 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f6068d3-d38e-4af8-bc7b-86bb44554ce6-cert\") pod \"odh-model-controller-7998c67dc4-d4vbc\" (UID: \"8f6068d3-d38e-4af8-bc7b-86bb44554ce6\") " pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" Jul 03 19:16:50.929594 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.929560 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vdbk2"] Jul 03 19:16:50.932605 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.932584 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" Jul 03 19:16:50.935076 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.935057 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 03 19:16:50.943116 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.943095 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vdbk2"] Jul 03 19:16:50.954864 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:50.954512 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:51.017470 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.017383 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" Jul 03 19:16:51.064070 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.063944 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfxxl\" (UniqueName: \"kubernetes.io/projected/e372f4e3-daa8-4c52-b641-44831273f48f-kube-api-access-vfxxl\") pod \"model-serving-api-54d89bd5fc-vdbk2\" (UID: \"e372f4e3-daa8-4c52-b641-44831273f48f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" Jul 03 19:16:51.064259 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.064096 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e372f4e3-daa8-4c52-b641-44831273f48f-tls-certs\") pod \"model-serving-api-54d89bd5fc-vdbk2\" (UID: \"e372f4e3-daa8-4c52-b641-44831273f48f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" Jul 03 19:16:51.143020 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.142974 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:51.150768 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.149279 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk"] Jul 03 19:16:51.165589 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.165550 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfxxl\" (UniqueName: \"kubernetes.io/projected/e372f4e3-daa8-4c52-b641-44831273f48f-kube-api-access-vfxxl\") pod \"model-serving-api-54d89bd5fc-vdbk2\" (UID: \"e372f4e3-daa8-4c52-b641-44831273f48f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" Jul 03 19:16:51.166929 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.166905 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e372f4e3-daa8-4c52-b641-44831273f48f-tls-certs\") pod \"model-serving-api-54d89bd5fc-vdbk2\" (UID: \"e372f4e3-daa8-4c52-b641-44831273f48f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" Jul 03 19:16:51.167680 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.167640 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk"] Jul 03 19:16:51.167792 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.167740 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.174570 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.172695 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dgnrf\"" Jul 03 19:16:51.174570 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.172944 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 03 19:16:51.174570 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.173152 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 03 19:16:51.174570 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.173329 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 03 19:16:51.174570 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.173510 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 03 19:16:51.175384 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.175333 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e372f4e3-daa8-4c52-b641-44831273f48f-tls-certs\") pod \"model-serving-api-54d89bd5fc-vdbk2\" (UID: \"e372f4e3-daa8-4c52-b641-44831273f48f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" Jul 03 19:16:51.179427 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.179385 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfxxl\" (UniqueName: \"kubernetes.io/projected/e372f4e3-daa8-4c52-b641-44831273f48f-kube-api-access-vfxxl\") pod \"model-serving-api-54d89bd5fc-vdbk2\" (UID: \"e372f4e3-daa8-4c52-b641-44831273f48f\") " pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" Jul 03 19:16:51.193901 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.193874 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-d4vbc"] Jul 03 19:16:51.196051 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:16:51.196012 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f6068d3_d38e_4af8_bc7b_86bb44554ce6.slice/crio-66dd98175199717a685e55c287fff19a748e2a8e049dc124ecb643d31868545e WatchSource:0}: Error finding container 66dd98175199717a685e55c287fff19a748e2a8e049dc124ecb643d31868545e: Status 404 returned error can't find the container with id 66dd98175199717a685e55c287fff19a748e2a8e049dc124ecb643d31868545e Jul 03 19:16:51.231541 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.231511 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:51.244469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.244427 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" Jul 03 19:16:51.269061 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.268995 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-token\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.269061 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.269042 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42czp\" (UniqueName: \"kubernetes.io/projected/a84656eb-2af7-4d0b-87a8-d95c8b95defd-kube-api-access-42czp\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.269494 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.269082 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-cacerts\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.269494 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.269137 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.269494 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.269200 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a84656eb-2af7-4d0b-87a8-d95c8b95defd-local-certs\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.269494 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.269239 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.269494 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.269291 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.271946 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.271914 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" event={"ID":"8f6068d3-d38e-4af8-bc7b-86bb44554ce6","Type":"ContainerStarted","Data":"66dd98175199717a685e55c287fff19a748e2a8e049dc124ecb643d31868545e"} Jul 03 19:16:51.273472 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.273412 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" event={"ID":"9a829d83-4443-450c-87cc-f7f1ce2d6771","Type":"ContainerStarted","Data":"69a82161f3a9019c1741bc1a910a8f7024304df2f20578dcfbc2ca1139cad5d1"} Jul 03 19:16:51.370632 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.370588 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a84656eb-2af7-4d0b-87a8-d95c8b95defd-local-certs\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.370877 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.370659 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.370877 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.370725 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.370877 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.370822 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-token\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.370877 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.370849 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42czp\" (UniqueName: \"kubernetes.io/projected/a84656eb-2af7-4d0b-87a8-d95c8b95defd-kube-api-access-42czp\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.371204 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.370886 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-cacerts\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.371204 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.370957 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.373065 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.373015 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.376532 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.376366 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.376532 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.376447 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-cacerts\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.378766 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.378719 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.379434 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.379386 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a84656eb-2af7-4d0b-87a8-d95c8b95defd-local-certs\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.380111 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.380072 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-token\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.382391 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.380634 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42czp\" (UniqueName: \"kubernetes.io/projected/a84656eb-2af7-4d0b-87a8-d95c8b95defd-kube-api-access-42czp\") pod \"istiod-openshift-gateway-7574459656-bqpvk\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.410366 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.410343 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vdbk2"] Jul 03 19:16:51.412987 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:16:51.412958 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode372f4e3_daa8_4c52_b641_44831273f48f.slice/crio-225e8052bd30ad11d38a819f7a1b85c1cd7dc0f23965ac5ead1c7eb9cff8977f WatchSource:0}: Error finding container 225e8052bd30ad11d38a819f7a1b85c1cd7dc0f23965ac5ead1c7eb9cff8977f: Status 404 returned error can't find the container with id 225e8052bd30ad11d38a819f7a1b85c1cd7dc0f23965ac5ead1c7eb9cff8977f Jul 03 19:16:51.509387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.509353 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:51.656549 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:51.656523 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk"] Jul 03 19:16:51.658427 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:16:51.658396 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda84656eb_2af7_4d0b_87a8_d95c8b95defd.slice/crio-1b6bacc35d77d0fe34d81ed0dca3a582fb490fdb2719d92616dd01417e17150f WatchSource:0}: Error finding container 1b6bacc35d77d0fe34d81ed0dca3a582fb490fdb2719d92616dd01417e17150f: Status 404 returned error can't find the container with id 1b6bacc35d77d0fe34d81ed0dca3a582fb490fdb2719d92616dd01417e17150f Jul 03 19:16:52.061122 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:52.061036 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:52.283451 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:52.283414 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" event={"ID":"e372f4e3-daa8-4c52-b641-44831273f48f","Type":"ContainerStarted","Data":"225e8052bd30ad11d38a819f7a1b85c1cd7dc0f23965ac5ead1c7eb9cff8977f"} Jul 03 19:16:52.285196 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:52.285170 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" event={"ID":"a84656eb-2af7-4d0b-87a8-d95c8b95defd","Type":"ContainerStarted","Data":"1b6bacc35d77d0fe34d81ed0dca3a582fb490fdb2719d92616dd01417e17150f"} Jul 03 19:16:56.484619 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:56.484560 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 19:16:56.490869 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:56.485275 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 19:16:57.009011 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.008957 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:57.111756 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.111725 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:57.255502 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.255474 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:57.312387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.312348 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" event={"ID":"9a829d83-4443-450c-87cc-f7f1ce2d6771","Type":"ContainerStarted","Data":"cec2b28114bb8f0e04a5a63949667da16da148aec057190e826beb5db86126cd"} Jul 03 19:16:57.314125 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.314098 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" event={"ID":"a84656eb-2af7-4d0b-87a8-d95c8b95defd","Type":"ContainerStarted","Data":"0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f"} Jul 03 19:16:57.314257 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.314213 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:57.315794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.315743 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" event={"ID":"8f6068d3-d38e-4af8-bc7b-86bb44554ce6","Type":"ContainerStarted","Data":"fa6d9062023b5dcf5808f4509f7a000ae5f32097a595e95b1edce4f86634a18b"} Jul 03 19:16:57.315905 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.315885 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" Jul 03 19:16:57.316082 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.316058 2587 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-bqpvk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 03 19:16:57.316168 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.316105 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" podUID="a84656eb-2af7-4d0b-87a8-d95c8b95defd" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 03 19:16:57.317312 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.317292 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" event={"ID":"e372f4e3-daa8-4c52-b641-44831273f48f","Type":"ContainerStarted","Data":"1cf0c3e51576319820b6e4fe6c27e3a0e0a70c931fe571cf451fe922e4506263"} Jul 03 19:16:57.317441 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.317423 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" Jul 03 19:16:57.344661 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.344598 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-994f4989b-9hntc" podStartSLOduration=2.35920898 podStartE2EDuration="8.344579046s" totalImagesPullingTime="5.985370066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:57.343663704 +0000 UTC m=+397.491315961" watchObservedRunningTime="2026-07-03 19:16:57.344579046 +0000 UTC m=+397.492231304" Jul 03 19:16:57.370651 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.370591 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" podStartSLOduration=2.379755791 podStartE2EDuration="7.370571798s" totalImagesPullingTime="4.990816007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:57.369472495 +0000 UTC m=+397.517124754" watchObservedRunningTime="2026-07-03 19:16:57.370571798 +0000 UTC m=+397.518224058" Jul 03 19:16:57.391905 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.391850 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" podStartSLOduration=2.183717653 podStartE2EDuration="7.3918317s" totalImagesPullingTime="5.208114047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:57.389971096 +0000 UTC m=+397.537623380" watchObservedRunningTime="2026-07-03 19:16:57.3918317 +0000 UTC m=+397.539484002" Jul 03 19:16:57.415263 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.415209 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" podStartSLOduration=1.59156325 podStartE2EDuration="6.41519186s" totalImagesPullingTime="4.82362861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:16:57.414103649 +0000 UTC m=+397.561755936" watchObservedRunningTime="2026-07-03 19:16:57.41519186 +0000 UTC m=+397.562844118" Jul 03 19:16:57.553533 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.553497 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:57.792678 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:57.792603 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:16:58.322902 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:58.322879 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:16:59.421084 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.421048 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q"] Jul 03 19:16:59.424457 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.424432 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.446323 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.446292 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q"] Jul 03 19:16:59.551515 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.551478 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.551672 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.551526 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.551672 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.551592 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.551672 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.551627 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.551672 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.551657 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.551831 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.551676 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.551831 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.551748 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc8lb\" (UniqueName: \"kubernetes.io/projected/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-kube-api-access-zc8lb\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.653006 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.652966 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.653201 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.653016 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.653201 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.653057 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.653201 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.653098 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.653356 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.653232 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.653356 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.653274 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.653452 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.653377 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc8lb\" (UniqueName: \"kubernetes.io/projected/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-kube-api-access-zc8lb\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.653963 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.653940 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.655628 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.655603 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.655742 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.655675 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.655826 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.655762 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.655882 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.655824 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.661955 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.661929 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.662110 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.662089 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc8lb\" (UniqueName: \"kubernetes.io/projected/456b8ec8-eaf3-44ed-9cc6-5af3740ac744-kube-api-access-zc8lb\") pod \"istiod-openshift-gateway-94bb8fbfd-k6z8q\" (UID: \"456b8ec8-eaf3-44ed-9cc6-5af3740ac744\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.735214 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.735112 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:16:59.911379 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.911314 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q"] Jul 03 19:16:59.914229 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:16:59.914201 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456b8ec8_eaf3_44ed_9cc6_5af3740ac744.slice/crio-5d3d7194a3ede238c8fba905100ffeee4ec061b7615c6b0b92296c3d5aa9b697 WatchSource:0}: Error finding container 5d3d7194a3ede238c8fba905100ffeee4ec061b7615c6b0b92296c3d5aa9b697: Status 404 returned error can't find the container with id 5d3d7194a3ede238c8fba905100ffeee4ec061b7615c6b0b92296c3d5aa9b697 Jul 03 19:16:59.917706 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.917670 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 19:16:59.917806 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:16:59.917735 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 19:17:00.338825 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:00.338760 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" event={"ID":"456b8ec8-eaf3-44ed-9cc6-5af3740ac744","Type":"ContainerStarted","Data":"3a6c46b5b6fa0aef4fc462aa0a14afa03e43442ddbb9353706dc84806f04dbc9"} Jul 03 19:17:00.339489 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:00.338844 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" event={"ID":"456b8ec8-eaf3-44ed-9cc6-5af3740ac744","Type":"ContainerStarted","Data":"5d3d7194a3ede238c8fba905100ffeee4ec061b7615c6b0b92296c3d5aa9b697"} Jul 03 19:17:00.339489 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:00.339014 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:17:00.340710 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:00.340682 2587 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-k6z8q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 03 19:17:00.340876 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:00.340740 2587 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" podUID="456b8ec8-eaf3-44ed-9cc6-5af3740ac744" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 03 19:17:00.382989 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:00.382934 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" podStartSLOduration=1.382915852 podStartE2EDuration="1.382915852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:16:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:17:00.381312693 +0000 UTC m=+400.528964977" watchObservedRunningTime="2026-07-03 19:17:00.382915852 +0000 UTC m=+400.530568110" Jul 03 19:17:00.989267 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:00.989236 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:17:01.085680 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.085614 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:17:01.326563 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.326529 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:17:01.344261 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.344232 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-k6z8q" Jul 03 19:17:01.485503 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.485468 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk"] Jul 03 19:17:01.485705 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.485671 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" podUID="a84656eb-2af7-4d0b-87a8-d95c8b95defd" containerName="discovery" containerID="cri-o://0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f" gracePeriod=30 Jul 03 19:17:01.567704 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.567666 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:17:01.778979 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.778952 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:17:01.876364 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.876261 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42czp\" (UniqueName: \"kubernetes.io/projected/a84656eb-2af7-4d0b-87a8-d95c8b95defd-kube-api-access-42czp\") pod \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " Jul 03 19:17:01.876364 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.876300 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a84656eb-2af7-4d0b-87a8-d95c8b95defd-local-certs\") pod \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " Jul 03 19:17:01.876364 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.876320 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-csr-ca-configmap\") pod \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " Jul 03 19:17:01.876364 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.876349 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-token\") pod \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " Jul 03 19:17:01.876701 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.876407 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-kubeconfig\") pod \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " Jul 03 19:17:01.876701 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.876436 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-cacerts\") pod \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " Jul 03 19:17:01.876701 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.876543 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-csr-dns-cert\") pod \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\" (UID: \"a84656eb-2af7-4d0b-87a8-d95c8b95defd\") " Jul 03 19:17:01.876903 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.876694 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a84656eb-2af7-4d0b-87a8-d95c8b95defd" (UID: "a84656eb-2af7-4d0b-87a8-d95c8b95defd"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:17:01.876958 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.876927 2587 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-csr-ca-configmap\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:17:01.879022 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.878993 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-cacerts" (OuterVolumeSpecName: "cacerts") pod "a84656eb-2af7-4d0b-87a8-d95c8b95defd" (UID: "a84656eb-2af7-4d0b-87a8-d95c8b95defd"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:17:01.879162 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.879089 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a84656eb-2af7-4d0b-87a8-d95c8b95defd" (UID: "a84656eb-2af7-4d0b-87a8-d95c8b95defd"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:17:01.879237 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.879195 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a84656eb-2af7-4d0b-87a8-d95c8b95defd-kube-api-access-42czp" (OuterVolumeSpecName: "kube-api-access-42czp") pod "a84656eb-2af7-4d0b-87a8-d95c8b95defd" (UID: "a84656eb-2af7-4d0b-87a8-d95c8b95defd"). InnerVolumeSpecName "kube-api-access-42czp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:17:01.879488 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.879457 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a84656eb-2af7-4d0b-87a8-d95c8b95defd" (UID: "a84656eb-2af7-4d0b-87a8-d95c8b95defd"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:17:01.879488 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.879480 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-token" (OuterVolumeSpecName: "istio-token") pod "a84656eb-2af7-4d0b-87a8-d95c8b95defd" (UID: "a84656eb-2af7-4d0b-87a8-d95c8b95defd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:17:01.879624 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.879494 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a84656eb-2af7-4d0b-87a8-d95c8b95defd-local-certs" (OuterVolumeSpecName: "local-certs") pod "a84656eb-2af7-4d0b-87a8-d95c8b95defd" (UID: "a84656eb-2af7-4d0b-87a8-d95c8b95defd"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:17:01.977660 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.977624 2587 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-csr-dns-cert\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:17:01.977660 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.977654 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42czp\" (UniqueName: \"kubernetes.io/projected/a84656eb-2af7-4d0b-87a8-d95c8b95defd-kube-api-access-42czp\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:17:01.977660 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.977665 2587 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a84656eb-2af7-4d0b-87a8-d95c8b95defd-local-certs\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:17:01.977660 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.977673 2587 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-token\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:17:01.977970 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.977681 2587 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-istio-kubeconfig\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:17:01.977970 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:01.977688 2587 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a84656eb-2af7-4d0b-87a8-d95c8b95defd-cacerts\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:17:02.267602 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:02.267512 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:17:02.349836 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:02.349799 2587 generic.go:356] "Generic (PLEG): container finished" podID="a84656eb-2af7-4d0b-87a8-d95c8b95defd" containerID="0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f" exitCode=0 Jul 03 19:17:02.350008 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:02.349900 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" event={"ID":"a84656eb-2af7-4d0b-87a8-d95c8b95defd","Type":"ContainerDied","Data":"0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f"} Jul 03 19:17:02.350008 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:02.349937 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" Jul 03 19:17:02.350008 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:02.349948 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk" event={"ID":"a84656eb-2af7-4d0b-87a8-d95c8b95defd","Type":"ContainerDied","Data":"1b6bacc35d77d0fe34d81ed0dca3a582fb490fdb2719d92616dd01417e17150f"} Jul 03 19:17:02.350008 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:02.349974 2587 scope.go:117] "RemoveContainer" containerID="0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f" Jul 03 19:17:02.358973 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:02.358948 2587 scope.go:117] "RemoveContainer" containerID="0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f" Jul 03 19:17:02.359291 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:17:02.359268 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f\": container with ID starting with 0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f not found: ID does not exist" containerID="0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f" Jul 03 19:17:02.359369 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:02.359304 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f"} err="failed to get container status \"0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f\": rpc error: code = NotFound desc = could not find container \"0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f\": container with ID starting with 0679bc7ea756aff400f27a4308298836b28e7578c35ec5e79108a775394e009f not found: ID does not exist" Jul 03 19:17:02.388190 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:02.388149 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk"] Jul 03 19:17:02.393464 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:02.393434 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bqpvk"] Jul 03 19:17:02.399936 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:02.399891 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:17:02.508757 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:02.508722 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:17:03.446273 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:03.446230 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a84656eb-2af7-4d0b-87a8-d95c8b95defd" path="/var/lib/kubelet/pods/a84656eb-2af7-4d0b-87a8-d95c8b95defd/volumes" Jul 03 19:17:08.324860 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:08.324825 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-d4vbc" Jul 03 19:17:08.326761 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:08.326735 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vdbk2" Jul 03 19:17:50.737632 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:50.737547 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:17:50.839242 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:50.839205 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:17:50.880052 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:50.880020 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fj9rl"] Jul 03 19:17:50.880387 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:50.880374 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a84656eb-2af7-4d0b-87a8-d95c8b95defd" containerName="discovery" Jul 03 19:17:50.880430 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:50.880389 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="a84656eb-2af7-4d0b-87a8-d95c8b95defd" containerName="discovery" Jul 03 19:17:50.880463 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:50.880455 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="a84656eb-2af7-4d0b-87a8-d95c8b95defd" containerName="discovery" Jul 03 19:17:50.882432 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:50.882415 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" Jul 03 19:17:50.885122 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:50.885095 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 03 19:17:50.886003 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:50.885981 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9dwgf\"" Jul 03 19:17:50.886140 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:50.885981 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 03 19:17:50.893072 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:50.893048 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fj9rl"] Jul 03 19:17:50.920240 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:50.920211 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:17:51.014272 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.014184 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx6kb\" (UniqueName: \"kubernetes.io/projected/a7262c07-882e-43e1-869f-135f5ef1f2fe-kube-api-access-xx6kb\") pod \"kuadrant-operator-catalog-fj9rl\" (UID: \"a7262c07-882e-43e1-869f-135f5ef1f2fe\") " pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" Jul 03 19:17:51.115150 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.115114 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx6kb\" (UniqueName: \"kubernetes.io/projected/a7262c07-882e-43e1-869f-135f5ef1f2fe-kube-api-access-xx6kb\") pod \"kuadrant-operator-catalog-fj9rl\" (UID: \"a7262c07-882e-43e1-869f-135f5ef1f2fe\") " pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" Jul 03 19:17:51.122930 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.122903 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx6kb\" (UniqueName: \"kubernetes.io/projected/a7262c07-882e-43e1-869f-135f5ef1f2fe-kube-api-access-xx6kb\") pod \"kuadrant-operator-catalog-fj9rl\" (UID: \"a7262c07-882e-43e1-869f-135f5ef1f2fe\") " pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" Jul 03 19:17:51.194397 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.194364 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" Jul 03 19:17:51.246360 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.246325 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fj9rl"] Jul 03 19:17:51.324322 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.324294 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fj9rl"] Jul 03 19:17:51.326601 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:17:51.326577 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7262c07_882e_43e1_869f_135f5ef1f2fe.slice/crio-4da6ffb89508e4398c409dbe309f542346af4e9585114bc29e078d5a35b98ede WatchSource:0}: Error finding container 4da6ffb89508e4398c409dbe309f542346af4e9585114bc29e078d5a35b98ede: Status 404 returned error can't find the container with id 4da6ffb89508e4398c409dbe309f542346af4e9585114bc29e078d5a35b98ede Jul 03 19:17:51.454040 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.454003 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-khq2k"] Jul 03 19:17:51.463646 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.463572 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-khq2k" Jul 03 19:17:51.464982 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.464944 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-khq2k"] Jul 03 19:17:51.568794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.568739 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" event={"ID":"a7262c07-882e-43e1-869f-135f5ef1f2fe","Type":"ContainerStarted","Data":"4da6ffb89508e4398c409dbe309f542346af4e9585114bc29e078d5a35b98ede"} Jul 03 19:17:51.619271 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.619237 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hvdt\" (UniqueName: \"kubernetes.io/projected/5a0d69d3-3167-44f2-8885-88f06130d225-kube-api-access-8hvdt\") pod \"kuadrant-operator-catalog-khq2k\" (UID: \"5a0d69d3-3167-44f2-8885-88f06130d225\") " pod="kuadrant-system/kuadrant-operator-catalog-khq2k" Jul 03 19:17:51.673158 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.673124 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:17:51.720275 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.720242 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hvdt\" (UniqueName: \"kubernetes.io/projected/5a0d69d3-3167-44f2-8885-88f06130d225-kube-api-access-8hvdt\") pod \"kuadrant-operator-catalog-khq2k\" (UID: \"5a0d69d3-3167-44f2-8885-88f06130d225\") " pod="kuadrant-system/kuadrant-operator-catalog-khq2k" Jul 03 19:17:51.727664 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.727640 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hvdt\" (UniqueName: \"kubernetes.io/projected/5a0d69d3-3167-44f2-8885-88f06130d225-kube-api-access-8hvdt\") pod \"kuadrant-operator-catalog-khq2k\" (UID: \"5a0d69d3-3167-44f2-8885-88f06130d225\") " pod="kuadrant-system/kuadrant-operator-catalog-khq2k" Jul 03 19:17:51.774754 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.774714 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-khq2k" Jul 03 19:17:51.898757 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.898726 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:17:51.906729 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:51.906708 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-khq2k"] Jul 03 19:17:51.909237 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:17:51.909210 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0d69d3_3167_44f2_8885_88f06130d225.slice/crio-2204c0c1499f99695cfda8477772200190fd728df2f57d37ac58fc1333390699 WatchSource:0}: Error finding container 2204c0c1499f99695cfda8477772200190fd728df2f57d37ac58fc1333390699: Status 404 returned error can't find the container with id 2204c0c1499f99695cfda8477772200190fd728df2f57d37ac58fc1333390699 Jul 03 19:17:52.576839 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:52.576800 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-khq2k" event={"ID":"5a0d69d3-3167-44f2-8885-88f06130d225","Type":"ContainerStarted","Data":"2204c0c1499f99695cfda8477772200190fd728df2f57d37ac58fc1333390699"} Jul 03 19:17:54.587288 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:54.587252 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" event={"ID":"a7262c07-882e-43e1-869f-135f5ef1f2fe","Type":"ContainerStarted","Data":"94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a"} Jul 03 19:17:54.587843 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:54.587315 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" podUID="a7262c07-882e-43e1-869f-135f5ef1f2fe" containerName="registry-server" containerID="cri-o://94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a" gracePeriod=2 Jul 03 19:17:54.588817 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:54.588765 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-khq2k" event={"ID":"5a0d69d3-3167-44f2-8885-88f06130d225","Type":"ContainerStarted","Data":"a2301dc40613bd8a245472967965dce58e5dd91c4ed20f247d0e9f385a596421"} Jul 03 19:17:54.603302 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:54.603259 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" podStartSLOduration=2.255102908 podStartE2EDuration="4.603243555s" totalImagesPullingTime="2.348140647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:17:54.602404715 +0000 UTC m=+454.750057011" watchObservedRunningTime="2026-07-03 19:17:54.603243555 +0000 UTC m=+454.750895812" Jul 03 19:17:54.617554 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:54.617506 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-khq2k" podStartSLOduration=1.847974302 podStartE2EDuration="3.617492304s" totalImagesPullingTime="1.769518002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:17:54.615480723 +0000 UTC m=+454.763133000" watchObservedRunningTime="2026-07-03 19:17:54.617492304 +0000 UTC m=+454.765144562" Jul 03 19:17:54.829545 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:54.829521 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" Jul 03 19:17:54.947717 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:54.947636 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx6kb\" (UniqueName: \"kubernetes.io/projected/a7262c07-882e-43e1-869f-135f5ef1f2fe-kube-api-access-xx6kb\") pod \"a7262c07-882e-43e1-869f-135f5ef1f2fe\" (UID: \"a7262c07-882e-43e1-869f-135f5ef1f2fe\") " Jul 03 19:17:54.949825 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:54.949800 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7262c07-882e-43e1-869f-135f5ef1f2fe-kube-api-access-xx6kb" (OuterVolumeSpecName: "kube-api-access-xx6kb") pod "a7262c07-882e-43e1-869f-135f5ef1f2fe" (UID: "a7262c07-882e-43e1-869f-135f5ef1f2fe"). InnerVolumeSpecName "kube-api-access-xx6kb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:17:55.048393 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:55.048357 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx6kb\" (UniqueName: \"kubernetes.io/projected/a7262c07-882e-43e1-869f-135f5ef1f2fe-kube-api-access-xx6kb\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:17:55.594942 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:55.594908 2587 generic.go:356] "Generic (PLEG): container finished" podID="a7262c07-882e-43e1-869f-135f5ef1f2fe" containerID="94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a" exitCode=0 Jul 03 19:17:55.595443 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:55.594973 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" Jul 03 19:17:55.595443 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:55.595001 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" event={"ID":"a7262c07-882e-43e1-869f-135f5ef1f2fe","Type":"ContainerDied","Data":"94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a"} Jul 03 19:17:55.595443 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:55.595089 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fj9rl" event={"ID":"a7262c07-882e-43e1-869f-135f5ef1f2fe","Type":"ContainerDied","Data":"4da6ffb89508e4398c409dbe309f542346af4e9585114bc29e078d5a35b98ede"} Jul 03 19:17:55.595443 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:55.595117 2587 scope.go:117] "RemoveContainer" containerID="94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a" Jul 03 19:17:55.604258 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:55.604242 2587 scope.go:117] "RemoveContainer" containerID="94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a" Jul 03 19:17:55.604516 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:17:55.604497 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a\": container with ID starting with 94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a not found: ID does not exist" containerID="94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a" Jul 03 19:17:55.604574 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:55.604529 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a"} err="failed to get container status \"94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a\": rpc error: code = NotFound desc = could not find container \"94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a\": container with ID starting with 94c928ac972fb974f35e5f6487b25a4e6f645a4e9f0c674066a139dbaafd199a not found: ID does not exist" Jul 03 19:17:55.609733 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:55.609706 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fj9rl"] Jul 03 19:17:55.612871 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:55.612847 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fj9rl"] Jul 03 19:17:57.445167 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:17:57.445133 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7262c07-882e-43e1-869f-135f5ef1f2fe" path="/var/lib/kubelet/pods/a7262c07-882e-43e1-869f-135f5ef1f2fe/volumes" Jul 03 19:18:01.775259 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:01.775227 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-khq2k" Jul 03 19:18:01.775757 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:01.775275 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-khq2k" Jul 03 19:18:01.798217 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:01.798190 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-khq2k" Jul 03 19:18:02.657024 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:02.656995 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-khq2k" Jul 03 19:18:13.040484 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:13.040451 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:13.127727 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:13.127678 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:19.272437 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:19.272401 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:21.420940 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:21.420899 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:21.513718 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:21.513688 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:21.953076 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:21.953038 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8554d56975-vrvqw"] Jul 03 19:18:21.953516 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:21.953491 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7262c07-882e-43e1-869f-135f5ef1f2fe" containerName="registry-server" Jul 03 19:18:21.953516 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:21.953515 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7262c07-882e-43e1-869f-135f5ef1f2fe" containerName="registry-server" Jul 03 19:18:21.953733 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:21.953589 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7262c07-882e-43e1-869f-135f5ef1f2fe" containerName="registry-server" Jul 03 19:18:21.957725 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:21.957707 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:21.969053 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:21.969029 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8554d56975-vrvqw"] Jul 03 19:18:22.013252 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.013220 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:22.076261 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.076228 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0782921c-e723-4e06-b586-661de50d940f-console-serving-cert\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.076417 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.076267 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0782921c-e723-4e06-b586-661de50d940f-oauth-serving-cert\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.076417 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.076288 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0782921c-e723-4e06-b586-661de50d940f-console-oauth-config\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.076417 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.076353 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0782921c-e723-4e06-b586-661de50d940f-console-config\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.076417 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.076411 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh4qf\" (UniqueName: \"kubernetes.io/projected/0782921c-e723-4e06-b586-661de50d940f-kube-api-access-bh4qf\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.076659 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.076445 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0782921c-e723-4e06-b586-661de50d940f-service-ca\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.076659 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.076483 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0782921c-e723-4e06-b586-661de50d940f-trusted-ca-bundle\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.115256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.115224 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:22.177392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.177359 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0782921c-e723-4e06-b586-661de50d940f-service-ca\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.177538 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.177411 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0782921c-e723-4e06-b586-661de50d940f-trusted-ca-bundle\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.177538 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.177462 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0782921c-e723-4e06-b586-661de50d940f-console-serving-cert\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.177538 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.177483 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0782921c-e723-4e06-b586-661de50d940f-oauth-serving-cert\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.177538 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.177508 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0782921c-e723-4e06-b586-661de50d940f-console-oauth-config\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.177752 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.177539 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0782921c-e723-4e06-b586-661de50d940f-console-config\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.177752 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.177719 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh4qf\" (UniqueName: \"kubernetes.io/projected/0782921c-e723-4e06-b586-661de50d940f-kube-api-access-bh4qf\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.178256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.178229 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0782921c-e723-4e06-b586-661de50d940f-service-ca\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.178379 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.178237 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0782921c-e723-4e06-b586-661de50d940f-oauth-serving-cert\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.178379 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.178326 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0782921c-e723-4e06-b586-661de50d940f-console-config\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.178379 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.178355 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0782921c-e723-4e06-b586-661de50d940f-trusted-ca-bundle\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.180004 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.179974 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0782921c-e723-4e06-b586-661de50d940f-console-serving-cert\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.180103 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.180055 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0782921c-e723-4e06-b586-661de50d940f-console-oauth-config\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.184891 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.184872 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh4qf\" (UniqueName: \"kubernetes.io/projected/0782921c-e723-4e06-b586-661de50d940f-kube-api-access-bh4qf\") pod \"console-8554d56975-vrvqw\" (UID: \"0782921c-e723-4e06-b586-661de50d940f\") " pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.214573 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.214509 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:22.266846 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.266817 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:22.396821 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.396711 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8554d56975-vrvqw"] Jul 03 19:18:22.399278 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:18:22.399253 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0782921c_e723_4e06_b586_661de50d940f.slice/crio-a208abf281f434b061e9224700699665db13760a32e1d10d565cc2ce611ae88a WatchSource:0}: Error finding container a208abf281f434b061e9224700699665db13760a32e1d10d565cc2ce611ae88a: Status 404 returned error can't find the container with id a208abf281f434b061e9224700699665db13760a32e1d10d565cc2ce611ae88a Jul 03 19:18:22.723135 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.723101 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8554d56975-vrvqw" event={"ID":"0782921c-e723-4e06-b586-661de50d940f","Type":"ContainerStarted","Data":"957f2247b812074603591f37507b145494ebec3a982fb5520d28bda5c9ae9cde"} Jul 03 19:18:22.723543 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.723150 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8554d56975-vrvqw" event={"ID":"0782921c-e723-4e06-b586-661de50d940f","Type":"ContainerStarted","Data":"a208abf281f434b061e9224700699665db13760a32e1d10d565cc2ce611ae88a"} Jul 03 19:18:22.741640 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.741588 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8554d56975-vrvqw" podStartSLOduration=1.741570207 podStartE2EDuration="1.741570207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:18:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:18:22.739000687 +0000 UTC m=+482.886652972" watchObservedRunningTime="2026-07-03 19:18:22.741570207 +0000 UTC m=+482.889222464" Jul 03 19:18:22.752279 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.752253 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:22.818250 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:22.818221 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:23.313444 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:23.313407 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:23.415705 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:23.415673 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:24.818371 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:24.818337 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b"] Jul 03 19:18:24.826058 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:24.826039 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:24.828970 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:24.828949 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-97v6x\"" Jul 03 19:18:24.841431 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:24.841408 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b"] Jul 03 19:18:24.906482 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:24.906432 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71573448-5965-42bc-bc4f-798960df5a5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zvd4b\" (UID: \"71573448-5965-42bc-bc4f-798960df5a5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:24.906482 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:24.906490 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7z9z\" (UniqueName: \"kubernetes.io/projected/71573448-5965-42bc-bc4f-798960df5a5a-kube-api-access-r7z9z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zvd4b\" (UID: \"71573448-5965-42bc-bc4f-798960df5a5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:25.007792 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:25.007736 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7z9z\" (UniqueName: \"kubernetes.io/projected/71573448-5965-42bc-bc4f-798960df5a5a-kube-api-access-r7z9z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zvd4b\" (UID: \"71573448-5965-42bc-bc4f-798960df5a5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:25.007936 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:25.007887 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71573448-5965-42bc-bc4f-798960df5a5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zvd4b\" (UID: \"71573448-5965-42bc-bc4f-798960df5a5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:25.008234 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:25.008218 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71573448-5965-42bc-bc4f-798960df5a5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zvd4b\" (UID: \"71573448-5965-42bc-bc4f-798960df5a5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:25.016900 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:25.016874 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7z9z\" (UniqueName: \"kubernetes.io/projected/71573448-5965-42bc-bc4f-798960df5a5a-kube-api-access-r7z9z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zvd4b\" (UID: \"71573448-5965-42bc-bc4f-798960df5a5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:25.137163 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:25.137065 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:25.270485 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:25.270455 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b"] Jul 03 19:18:25.275144 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:18:25.275120 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71573448_5965_42bc_bc4f_798960df5a5a.slice/crio-a3042e7960493890cf99df6b22b1e66b00687c163bd0f2a553227009fd89d6cc WatchSource:0}: Error finding container a3042e7960493890cf99df6b22b1e66b00687c163bd0f2a553227009fd89d6cc: Status 404 returned error can't find the container with id a3042e7960493890cf99df6b22b1e66b00687c163bd0f2a553227009fd89d6cc Jul 03 19:18:25.737688 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:25.737644 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" event={"ID":"71573448-5965-42bc-bc4f-798960df5a5a","Type":"ContainerStarted","Data":"a3042e7960493890cf99df6b22b1e66b00687c163bd0f2a553227009fd89d6cc"} Jul 03 19:18:25.875195 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:25.875162 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:28.264569 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:28.264534 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:28.915940 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:28.915908 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:31.487229 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:31.487198 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rr88j"] Jul 03 19:18:31.490663 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:31.490640 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rr88j" Jul 03 19:18:31.492900 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:31.492876 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-clwjp\"" Jul 03 19:18:31.500528 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:31.500506 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rr88j"] Jul 03 19:18:31.570268 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:31.570237 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g5zd\" (UniqueName: \"kubernetes.io/projected/ff3659d0-8c50-47ab-a520-e6c87c8b0c56-kube-api-access-7g5zd\") pod \"authorino-operator-75cc8d5cb7-rr88j\" (UID: \"ff3659d0-8c50-47ab-a520-e6c87c8b0c56\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rr88j" Jul 03 19:18:31.671164 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:31.671125 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5zd\" (UniqueName: \"kubernetes.io/projected/ff3659d0-8c50-47ab-a520-e6c87c8b0c56-kube-api-access-7g5zd\") pod \"authorino-operator-75cc8d5cb7-rr88j\" (UID: \"ff3659d0-8c50-47ab-a520-e6c87c8b0c56\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rr88j" Jul 03 19:18:31.682308 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:31.682279 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g5zd\" (UniqueName: \"kubernetes.io/projected/ff3659d0-8c50-47ab-a520-e6c87c8b0c56-kube-api-access-7g5zd\") pod \"authorino-operator-75cc8d5cb7-rr88j\" (UID: \"ff3659d0-8c50-47ab-a520-e6c87c8b0c56\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-rr88j" Jul 03 19:18:31.769921 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:31.769829 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" event={"ID":"71573448-5965-42bc-bc4f-798960df5a5a","Type":"ContainerStarted","Data":"a7b69788c999b1bcecd9376d6374b63108945097d90056b95b3409c053c2d291"} Jul 03 19:18:31.769921 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:31.769907 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:31.802438 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:31.802352 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rr88j" Jul 03 19:18:31.821861 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:31.821767 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" podStartSLOduration=2.379598268 podStartE2EDuration="7.821751106s" totalImagesPullingTime="5.442152838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:18:31.821470689 +0000 UTC m=+491.969122953" watchObservedRunningTime="2026-07-03 19:18:31.821751106 +0000 UTC m=+491.969403420" Jul 03 19:18:31.956219 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:31.956192 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-rr88j"] Jul 03 19:18:31.958809 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:18:31.958756 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3659d0_8c50_47ab_a520_e6c87c8b0c56.slice/crio-cd4cde4bd96ae29e18adfa4758864cd8e6d429342295c24a9f398ebb18038429 WatchSource:0}: Error finding container cd4cde4bd96ae29e18adfa4758864cd8e6d429342295c24a9f398ebb18038429: Status 404 returned error can't find the container with id cd4cde4bd96ae29e18adfa4758864cd8e6d429342295c24a9f398ebb18038429 Jul 03 19:18:32.267606 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:32.267568 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:32.267815 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:32.267636 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:32.272425 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:32.272403 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:32.464485 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:32.464430 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:32.778406 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:32.778362 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rr88j" event={"ID":"ff3659d0-8c50-47ab-a520-e6c87c8b0c56","Type":"ContainerStarted","Data":"cd4cde4bd96ae29e18adfa4758864cd8e6d429342295c24a9f398ebb18038429"} Jul 03 19:18:32.784610 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:32.784441 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8554d56975-vrvqw" Jul 03 19:18:32.842495 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:32.842466 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5b499b46-9n97k"] Jul 03 19:18:32.955731 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:32.955698 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:33.055428 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:33.055389 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:33.154473 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:33.154440 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:33.873395 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:33.873355 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:33.968867 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:33.968827 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:34.790189 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:34.790151 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rr88j" event={"ID":"ff3659d0-8c50-47ab-a520-e6c87c8b0c56","Type":"ContainerStarted","Data":"b08109cc55ca0a5209ebdba56a69c5e570001ea9138cd213a0d76d2807dad47f"} Jul 03 19:18:34.790383 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:34.790344 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rr88j" Jul 03 19:18:34.807376 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:34.807324 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rr88j" podStartSLOduration=1.508891051 podStartE2EDuration="3.807309251s" totalImagesPullingTime="2.2984182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:18:34.806628414 +0000 UTC m=+494.954280695" watchObservedRunningTime="2026-07-03 19:18:34.807309251 +0000 UTC m=+494.954961508" Jul 03 19:18:37.151507 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:37.151478 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:37.483367 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:37.483293 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:37.583578 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:37.583550 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:42.781575 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:42.781544 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:44.349412 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.349377 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs"] Jul 03 19:18:44.352569 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.352551 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:44.365421 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.365395 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs"] Jul 03 19:18:44.474734 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.474698 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b"] Jul 03 19:18:44.474990 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.474942 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" podUID="71573448-5965-42bc-bc4f-798960df5a5a" containerName="manager" containerID="cri-o://a7b69788c999b1bcecd9376d6374b63108945097d90056b95b3409c053c2d291" gracePeriod=2 Jul 03 19:18:44.479812 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.479737 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b"] Jul 03 19:18:44.487250 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.487219 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ee98c42-8c4c-4dfb-9c52-4f11567f6081-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vmffs\" (UID: \"2ee98c42-8c4c-4dfb-9c52-4f11567f6081\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:44.487424 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.487401 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd7vm\" (UniqueName: \"kubernetes.io/projected/2ee98c42-8c4c-4dfb-9c52-4f11567f6081-kube-api-access-cd7vm\") pod \"kuadrant-operator-controller-manager-86878c769f-vmffs\" (UID: \"2ee98c42-8c4c-4dfb-9c52-4f11567f6081\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:44.495046 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.495020 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs"] Jul 03 19:18:44.495385 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.495357 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-cd7vm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" podUID="2ee98c42-8c4c-4dfb-9c52-4f11567f6081" Jul 03 19:18:44.497451 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.497431 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn"] Jul 03 19:18:44.497765 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.497754 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71573448-5965-42bc-bc4f-798960df5a5a" containerName="manager" Jul 03 19:18:44.497832 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.497767 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="71573448-5965-42bc-bc4f-798960df5a5a" containerName="manager" Jul 03 19:18:44.497869 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.497859 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="71573448-5965-42bc-bc4f-798960df5a5a" containerName="manager" Jul 03 19:18:44.501177 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.501144 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" Jul 03 19:18:44.502134 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.502113 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs"] Jul 03 19:18:44.514355 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.514331 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn"] Jul 03 19:18:44.528462 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.528428 2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zvd4b\" is forbidden: User \"system:node:ip-10-0-130-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-57.ec2.internal' and this object" podUID="71573448-5965-42bc-bc4f-798960df5a5a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:44.588205 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.588184 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd7vm\" (UniqueName: \"kubernetes.io/projected/2ee98c42-8c4c-4dfb-9c52-4f11567f6081-kube-api-access-cd7vm\") pod \"kuadrant-operator-controller-manager-86878c769f-vmffs\" (UID: \"2ee98c42-8c4c-4dfb-9c52-4f11567f6081\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:44.588265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.588232 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfwq6\" (UniqueName: \"kubernetes.io/projected/226e2f51-ece5-4e1e-b2dc-535ee5fb7698-kube-api-access-cfwq6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rngxn\" (UID: \"226e2f51-ece5-4e1e-b2dc-535ee5fb7698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" Jul 03 19:18:44.588307 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.588279 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ee98c42-8c4c-4dfb-9c52-4f11567f6081-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vmffs\" (UID: \"2ee98c42-8c4c-4dfb-9c52-4f11567f6081\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:44.588340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.588314 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/226e2f51-ece5-4e1e-b2dc-535ee5fb7698-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rngxn\" (UID: \"226e2f51-ece5-4e1e-b2dc-535ee5fb7698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" Jul 03 19:18:44.588659 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.588645 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ee98c42-8c4c-4dfb-9c52-4f11567f6081-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vmffs\" (UID: \"2ee98c42-8c4c-4dfb-9c52-4f11567f6081\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:44.592721 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.592700 2587 projected.go:196] Error preparing data for projected volume kube-api-access-cd7vm for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-vmffs" not found Jul 03 19:18:44.592835 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.592793 2587 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ee98c42-8c4c-4dfb-9c52-4f11567f6081-kube-api-access-cd7vm podName:2ee98c42-8c4c-4dfb-9c52-4f11567f6081 nodeName:}" failed. No retries permitted until 2026-07-03 19:18:45.092752179 +0000 UTC m=+505.240404416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cd7vm" (UniqueName: "kubernetes.io/projected/2ee98c42-8c4c-4dfb-9c52-4f11567f6081-kube-api-access-cd7vm") pod "kuadrant-operator-controller-manager-86878c769f-vmffs" (UID: "2ee98c42-8c4c-4dfb-9c52-4f11567f6081") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-vmffs" not found Jul 03 19:18:44.689512 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.689477 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfwq6\" (UniqueName: \"kubernetes.io/projected/226e2f51-ece5-4e1e-b2dc-535ee5fb7698-kube-api-access-cfwq6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rngxn\" (UID: \"226e2f51-ece5-4e1e-b2dc-535ee5fb7698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" Jul 03 19:18:44.689687 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.689559 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/226e2f51-ece5-4e1e-b2dc-535ee5fb7698-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rngxn\" (UID: \"226e2f51-ece5-4e1e-b2dc-535ee5fb7698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" Jul 03 19:18:44.689963 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.689942 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/226e2f51-ece5-4e1e-b2dc-535ee5fb7698-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rngxn\" (UID: \"226e2f51-ece5-4e1e-b2dc-535ee5fb7698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" Jul 03 19:18:44.699710 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.699681 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfwq6\" (UniqueName: \"kubernetes.io/projected/226e2f51-ece5-4e1e-b2dc-535ee5fb7698-kube-api-access-cfwq6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rngxn\" (UID: \"226e2f51-ece5-4e1e-b2dc-535ee5fb7698\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" Jul 03 19:18:44.714347 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.714325 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:44.716150 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.716128 2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zvd4b\" is forbidden: User \"system:node:ip-10-0-130-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-57.ec2.internal' and this object" podUID="71573448-5965-42bc-bc4f-798960df5a5a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:44.790092 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.790062 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7z9z\" (UniqueName: \"kubernetes.io/projected/71573448-5965-42bc-bc4f-798960df5a5a-kube-api-access-r7z9z\") pod \"71573448-5965-42bc-bc4f-798960df5a5a\" (UID: \"71573448-5965-42bc-bc4f-798960df5a5a\") " Jul 03 19:18:44.790224 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.790146 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71573448-5965-42bc-bc4f-798960df5a5a-extensions-socket-volume\") pod \"71573448-5965-42bc-bc4f-798960df5a5a\" (UID: \"71573448-5965-42bc-bc4f-798960df5a5a\") " Jul 03 19:18:44.790565 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.790537 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71573448-5965-42bc-bc4f-798960df5a5a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "71573448-5965-42bc-bc4f-798960df5a5a" (UID: "71573448-5965-42bc-bc4f-798960df5a5a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:18:44.792137 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.792117 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71573448-5965-42bc-bc4f-798960df5a5a-kube-api-access-r7z9z" (OuterVolumeSpecName: "kube-api-access-r7z9z") pod "71573448-5965-42bc-bc4f-798960df5a5a" (UID: "71573448-5965-42bc-bc4f-798960df5a5a"). InnerVolumeSpecName "kube-api-access-r7z9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:18:44.844709 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.844676 2587 generic.go:356] "Generic (PLEG): container finished" podID="71573448-5965-42bc-bc4f-798960df5a5a" containerID="a7b69788c999b1bcecd9376d6374b63108945097d90056b95b3409c053c2d291" exitCode=0 Jul 03 19:18:44.844891 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.844720 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:44.844891 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.844736 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:44.844891 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.844787 2587 scope.go:117] "RemoveContainer" containerID="a7b69788c999b1bcecd9376d6374b63108945097d90056b95b3409c053c2d291" Jul 03 19:18:44.846671 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.846642 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" Jul 03 19:18:44.846793 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.846658 2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zvd4b\" is forbidden: User \"system:node:ip-10-0-130-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-57.ec2.internal' and this object" podUID="71573448-5965-42bc-bc4f-798960df5a5a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:44.848454 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.848430 2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zvd4b\" is forbidden: User \"system:node:ip-10-0-130-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-57.ec2.internal' and this object" podUID="71573448-5965-42bc-bc4f-798960df5a5a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:44.850083 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.850062 2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-vmffs\" is forbidden: User \"system:node:ip-10-0-130-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-57.ec2.internal' and this object" podUID="2ee98c42-8c4c-4dfb-9c52-4f11567f6081" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:44.851907 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.851888 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:44.853867 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.853704 2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zvd4b\" is forbidden: User \"system:node:ip-10-0-130-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-57.ec2.internal' and this object" podUID="71573448-5965-42bc-bc4f-798960df5a5a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:44.855316 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.855293 2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-vmffs\" is forbidden: User \"system:node:ip-10-0-130-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-57.ec2.internal' and this object" podUID="2ee98c42-8c4c-4dfb-9c52-4f11567f6081" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:44.856982 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.856957 2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zvd4b\" is forbidden: User \"system:node:ip-10-0-130-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-57.ec2.internal' and this object" podUID="71573448-5965-42bc-bc4f-798960df5a5a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zvd4b" Jul 03 19:18:44.858260 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.858225 2587 scope.go:117] "RemoveContainer" containerID="a7b69788c999b1bcecd9376d6374b63108945097d90056b95b3409c053c2d291" Jul 03 19:18:44.858517 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.858492 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7b69788c999b1bcecd9376d6374b63108945097d90056b95b3409c053c2d291\": container with ID starting with a7b69788c999b1bcecd9376d6374b63108945097d90056b95b3409c053c2d291 not found: ID does not exist" containerID="a7b69788c999b1bcecd9376d6374b63108945097d90056b95b3409c053c2d291" Jul 03 19:18:44.858603 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.858523 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7b69788c999b1bcecd9376d6374b63108945097d90056b95b3409c053c2d291"} err="failed to get container status \"a7b69788c999b1bcecd9376d6374b63108945097d90056b95b3409c053c2d291\": rpc error: code = NotFound desc = could not find container \"a7b69788c999b1bcecd9376d6374b63108945097d90056b95b3409c053c2d291\": container with ID starting with a7b69788c999b1bcecd9376d6374b63108945097d90056b95b3409c053c2d291 not found: ID does not exist" Jul 03 19:18:44.858603 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:44.858564 2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-vmffs\" is forbidden: User \"system:node:ip-10-0-130-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-57.ec2.internal' and this object" podUID="2ee98c42-8c4c-4dfb-9c52-4f11567f6081" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:44.891178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.891148 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7z9z\" (UniqueName: \"kubernetes.io/projected/71573448-5965-42bc-bc4f-798960df5a5a-kube-api-access-r7z9z\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:18:44.891178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.891174 2587 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71573448-5965-42bc-bc4f-798960df5a5a-extensions-socket-volume\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:18:44.992343 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.992306 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ee98c42-8c4c-4dfb-9c52-4f11567f6081-extensions-socket-volume\") pod \"2ee98c42-8c4c-4dfb-9c52-4f11567f6081\" (UID: \"2ee98c42-8c4c-4dfb-9c52-4f11567f6081\") " Jul 03 19:18:44.992530 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.992517 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd7vm\" (UniqueName: \"kubernetes.io/projected/2ee98c42-8c4c-4dfb-9c52-4f11567f6081-kube-api-access-cd7vm\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:18:44.992576 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.992549 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ee98c42-8c4c-4dfb-9c52-4f11567f6081-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2ee98c42-8c4c-4dfb-9c52-4f11567f6081" (UID: "2ee98c42-8c4c-4dfb-9c52-4f11567f6081"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:18:44.998305 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:44.998283 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn"] Jul 03 19:18:45.000576 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:18:45.000548 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226e2f51_ece5_4e1e_b2dc_535ee5fb7698.slice/crio-9958f0315bb5c272232165aa40d341edeba8f8fffe37c19055dfffb489102da6 WatchSource:0}: Error finding container 9958f0315bb5c272232165aa40d341edeba8f8fffe37c19055dfffb489102da6: Status 404 returned error can't find the container with id 9958f0315bb5c272232165aa40d341edeba8f8fffe37c19055dfffb489102da6 Jul 03 19:18:45.093269 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:45.093245 2587 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ee98c42-8c4c-4dfb-9c52-4f11567f6081-extensions-socket-volume\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:18:45.445495 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:45.445461 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ee98c42-8c4c-4dfb-9c52-4f11567f6081" path="/var/lib/kubelet/pods/2ee98c42-8c4c-4dfb-9c52-4f11567f6081/volumes" Jul 03 19:18:45.445873 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:45.445730 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71573448-5965-42bc-bc4f-798960df5a5a" path="/var/lib/kubelet/pods/71573448-5965-42bc-bc4f-798960df5a5a/volumes" Jul 03 19:18:45.797340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:45.797314 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-rr88j" Jul 03 19:18:45.850866 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:45.850827 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" event={"ID":"226e2f51-ece5-4e1e-b2dc-535ee5fb7698","Type":"ContainerStarted","Data":"ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec"} Jul 03 19:18:45.851044 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:45.850897 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" Jul 03 19:18:45.851044 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:45.850923 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" event={"ID":"226e2f51-ece5-4e1e-b2dc-535ee5fb7698","Type":"ContainerStarted","Data":"9958f0315bb5c272232165aa40d341edeba8f8fffe37c19055dfffb489102da6"} Jul 03 19:18:45.851852 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:45.851826 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:45.871225 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:45.871183 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" podStartSLOduration=1.8711681850000002 podStartE2EDuration="1.871168185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:18:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:18:45.870422582 +0000 UTC m=+506.018074883" watchObservedRunningTime="2026-07-03 19:18:45.871168185 +0000 UTC m=+506.018820443" Jul 03 19:18:45.872351 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:45.872328 2587 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-vmffs\" is forbidden: User \"system:node:ip-10-0-130-57.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-57.ec2.internal' and this object" podUID="2ee98c42-8c4c-4dfb-9c52-4f11567f6081" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vmffs" Jul 03 19:18:48.119983 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:48.119918 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:48.214735 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:48.214703 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:49.307542 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:49.307497 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:50.264312 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:50.264261 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:50.319276 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:50.319243 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:50.861310 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:50.861261 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:50.962958 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:50.962903 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:51.692250 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:51.692207 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:53.869157 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:53.869123 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:53.966656 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:53.966624 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:18:56.858910 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:56.858879 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" Jul 03 19:18:57.874312 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:57.874253 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f5b499b46-9n97k" podUID="06c8cae4-4ce4-4002-b116-91357c25d5dc" containerName="console" containerID="cri-o://72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6" gracePeriod=15 Jul 03 19:18:58.134741 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.134682 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:18:58.309116 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.309086 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-service-ca\") pod \"06c8cae4-4ce4-4002-b116-91357c25d5dc\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " Jul 03 19:18:58.309291 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.309123 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-oauth-config\") pod \"06c8cae4-4ce4-4002-b116-91357c25d5dc\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " Jul 03 19:18:58.309291 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.309152 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f8l8\" (UniqueName: \"kubernetes.io/projected/06c8cae4-4ce4-4002-b116-91357c25d5dc-kube-api-access-4f8l8\") pod \"06c8cae4-4ce4-4002-b116-91357c25d5dc\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " Jul 03 19:18:58.309291 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.309175 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-oauth-serving-cert\") pod \"06c8cae4-4ce4-4002-b116-91357c25d5dc\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " Jul 03 19:18:58.309291 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.309231 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-config\") pod \"06c8cae4-4ce4-4002-b116-91357c25d5dc\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " Jul 03 19:18:58.309291 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.309250 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-trusted-ca-bundle\") pod \"06c8cae4-4ce4-4002-b116-91357c25d5dc\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " Jul 03 19:18:58.309528 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.309296 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-serving-cert\") pod \"06c8cae4-4ce4-4002-b116-91357c25d5dc\" (UID: \"06c8cae4-4ce4-4002-b116-91357c25d5dc\") " Jul 03 19:18:58.309592 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.309543 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-service-ca" (OuterVolumeSpecName: "service-ca") pod "06c8cae4-4ce4-4002-b116-91357c25d5dc" (UID: "06c8cae4-4ce4-4002-b116-91357c25d5dc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:18:58.309711 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.309678 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "06c8cae4-4ce4-4002-b116-91357c25d5dc" (UID: "06c8cae4-4ce4-4002-b116-91357c25d5dc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:18:58.309873 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.309749 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "06c8cae4-4ce4-4002-b116-91357c25d5dc" (UID: "06c8cae4-4ce4-4002-b116-91357c25d5dc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:18:58.309964 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.309945 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-config" (OuterVolumeSpecName: "console-config") pod "06c8cae4-4ce4-4002-b116-91357c25d5dc" (UID: "06c8cae4-4ce4-4002-b116-91357c25d5dc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:18:58.311404 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.311380 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c8cae4-4ce4-4002-b116-91357c25d5dc-kube-api-access-4f8l8" (OuterVolumeSpecName: "kube-api-access-4f8l8") pod "06c8cae4-4ce4-4002-b116-91357c25d5dc" (UID: "06c8cae4-4ce4-4002-b116-91357c25d5dc"). InnerVolumeSpecName "kube-api-access-4f8l8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:18:58.311503 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.311452 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "06c8cae4-4ce4-4002-b116-91357c25d5dc" (UID: "06c8cae4-4ce4-4002-b116-91357c25d5dc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:18:58.311503 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.311465 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "06c8cae4-4ce4-4002-b116-91357c25d5dc" (UID: "06c8cae4-4ce4-4002-b116-91357c25d5dc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:18:58.410599 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.410528 2587 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-config\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:18:58.410599 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.410554 2587 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-trusted-ca-bundle\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:18:58.410599 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.410565 2587 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-serving-cert\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:18:58.410599 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.410575 2587 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-service-ca\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:18:58.410599 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.410584 2587 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06c8cae4-4ce4-4002-b116-91357c25d5dc-console-oauth-config\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:18:58.410599 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.410592 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f8l8\" (UniqueName: \"kubernetes.io/projected/06c8cae4-4ce4-4002-b116-91357c25d5dc-kube-api-access-4f8l8\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:18:58.410599 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.410600 2587 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06c8cae4-4ce4-4002-b116-91357c25d5dc-oauth-serving-cert\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:18:58.917132 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.917097 2587 generic.go:356] "Generic (PLEG): container finished" podID="06c8cae4-4ce4-4002-b116-91357c25d5dc" containerID="72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6" exitCode=0 Jul 03 19:18:58.917564 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.917143 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5b499b46-9n97k" Jul 03 19:18:58.917564 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.917180 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5b499b46-9n97k" event={"ID":"06c8cae4-4ce4-4002-b116-91357c25d5dc","Type":"ContainerDied","Data":"72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6"} Jul 03 19:18:58.917564 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.917231 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5b499b46-9n97k" event={"ID":"06c8cae4-4ce4-4002-b116-91357c25d5dc","Type":"ContainerDied","Data":"125bc550df235067ae83a3ec7c762d7c6dad57d90b77c0025ff15dc90396f6d6"} Jul 03 19:18:58.917564 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.917250 2587 scope.go:117] "RemoveContainer" containerID="72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6" Jul 03 19:18:58.927177 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.927156 2587 scope.go:117] "RemoveContainer" containerID="72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6" Jul 03 19:18:58.927482 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:18:58.927462 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6\": container with ID starting with 72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6 not found: ID does not exist" containerID="72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6" Jul 03 19:18:58.927574 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.927489 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6"} err="failed to get container status \"72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6\": rpc error: code = NotFound desc = could not find container \"72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6\": container with ID starting with 72719c85d92cac4150c78b34186fcbe1790233704109a6c908a4f1da010bcba6 not found: ID does not exist" Jul 03 19:18:58.939743 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.939722 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5b499b46-9n97k"] Jul 03 19:18:58.943406 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:58.943382 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f5b499b46-9n97k"] Jul 03 19:18:59.445820 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:18:59.445768 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06c8cae4-4ce4-4002-b116-91357c25d5dc" path="/var/lib/kubelet/pods/06c8cae4-4ce4-4002-b116-91357c25d5dc/volumes" Jul 03 19:19:00.059934 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:00.059887 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:00.123214 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:00.123173 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:06.670679 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:06.670634 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:06.772689 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:06.772659 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:10.149998 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:10.149963 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:10.208815 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:10.208756 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:10.365902 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:10.365869 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:11.466561 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:11.466530 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:11.566947 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:11.566911 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:13.447039 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.446967 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn"] Jul 03 19:19:13.447526 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.447156 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" podUID="226e2f51-ece5-4e1e-b2dc-535ee5fb7698" containerName="manager" containerID="cri-o://ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec" gracePeriod=10 Jul 03 19:19:13.698292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.698236 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" Jul 03 19:19:13.737998 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.737959 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfwq6\" (UniqueName: \"kubernetes.io/projected/226e2f51-ece5-4e1e-b2dc-535ee5fb7698-kube-api-access-cfwq6\") pod \"226e2f51-ece5-4e1e-b2dc-535ee5fb7698\" (UID: \"226e2f51-ece5-4e1e-b2dc-535ee5fb7698\") " Jul 03 19:19:13.738163 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.738025 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/226e2f51-ece5-4e1e-b2dc-535ee5fb7698-extensions-socket-volume\") pod \"226e2f51-ece5-4e1e-b2dc-535ee5fb7698\" (UID: \"226e2f51-ece5-4e1e-b2dc-535ee5fb7698\") " Jul 03 19:19:13.738482 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.738458 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/226e2f51-ece5-4e1e-b2dc-535ee5fb7698-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "226e2f51-ece5-4e1e-b2dc-535ee5fb7698" (UID: "226e2f51-ece5-4e1e-b2dc-535ee5fb7698"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 19:19:13.740207 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.740182 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226e2f51-ece5-4e1e-b2dc-535ee5fb7698-kube-api-access-cfwq6" (OuterVolumeSpecName: "kube-api-access-cfwq6") pod "226e2f51-ece5-4e1e-b2dc-535ee5fb7698" (UID: "226e2f51-ece5-4e1e-b2dc-535ee5fb7698"). InnerVolumeSpecName "kube-api-access-cfwq6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:19:13.839313 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.839281 2587 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/226e2f51-ece5-4e1e-b2dc-535ee5fb7698-extensions-socket-volume\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:19:13.839313 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.839311 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfwq6\" (UniqueName: \"kubernetes.io/projected/226e2f51-ece5-4e1e-b2dc-535ee5fb7698-kube-api-access-cfwq6\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:19:13.933733 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.933703 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:13.991915 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.991815 2587 generic.go:356] "Generic (PLEG): container finished" podID="226e2f51-ece5-4e1e-b2dc-535ee5fb7698" containerID="ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec" exitCode=0 Jul 03 19:19:13.991915 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.991862 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" Jul 03 19:19:13.992111 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.991897 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" event={"ID":"226e2f51-ece5-4e1e-b2dc-535ee5fb7698","Type":"ContainerDied","Data":"ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec"} Jul 03 19:19:13.992111 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.991965 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn" event={"ID":"226e2f51-ece5-4e1e-b2dc-535ee5fb7698","Type":"ContainerDied","Data":"9958f0315bb5c272232165aa40d341edeba8f8fffe37c19055dfffb489102da6"} Jul 03 19:19:13.992111 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:13.991991 2587 scope.go:117] "RemoveContainer" containerID="ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec" Jul 03 19:19:14.001553 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:14.001537 2587 scope.go:117] "RemoveContainer" containerID="ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec" Jul 03 19:19:14.001857 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:19:14.001837 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec\": container with ID starting with ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec not found: ID does not exist" containerID="ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec" Jul 03 19:19:14.001938 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:14.001870 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec"} err="failed to get container status \"ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec\": rpc error: code = NotFound desc = could not find container \"ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec\": container with ID starting with ba6a03ddaa1a6fbd20f937f31813a60e5bad7c4608d584090f060b08a64097ec not found: ID does not exist" Jul 03 19:19:14.021109 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:14.021089 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn"] Jul 03 19:19:14.025306 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:14.025286 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:14.028292 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:14.028273 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rngxn"] Jul 03 19:19:15.445464 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:15.445428 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="226e2f51-ece5-4e1e-b2dc-535ee5fb7698" path="/var/lib/kubelet/pods/226e2f51-ece5-4e1e-b2dc-535ee5fb7698/volumes" Jul 03 19:19:19.675673 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:19.675637 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:19.733720 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:19.733691 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:27.072148 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:27.072110 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:27.172351 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:27.172319 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:28.744150 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:28.744118 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:29.734199 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.734168 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv"] Jul 03 19:19:29.734525 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.734513 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226e2f51-ece5-4e1e-b2dc-535ee5fb7698" containerName="manager" Jul 03 19:19:29.734571 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.734526 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="226e2f51-ece5-4e1e-b2dc-535ee5fb7698" containerName="manager" Jul 03 19:19:29.734571 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.734540 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c8cae4-4ce4-4002-b116-91357c25d5dc" containerName="console" Jul 03 19:19:29.734571 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.734546 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c8cae4-4ce4-4002-b116-91357c25d5dc" containerName="console" Jul 03 19:19:29.734663 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.734597 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="06c8cae4-4ce4-4002-b116-91357c25d5dc" containerName="console" Jul 03 19:19:29.734663 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.734607 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="226e2f51-ece5-4e1e-b2dc-535ee5fb7698" containerName="manager" Jul 03 19:19:29.737665 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.737645 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.740040 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.740012 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jm5kd\"" Jul 03 19:19:29.756718 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.756693 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv"] Jul 03 19:19:29.758664 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.758640 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:29.881430 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.881390 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.881629 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.881441 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.881629 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.881465 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.881629 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.881587 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.881629 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.881617 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4ckp\" (UniqueName: \"kubernetes.io/projected/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-kube-api-access-t4ckp\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.881920 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.881655 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.881920 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.881688 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.881920 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.881716 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.881920 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.881757 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.940193 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.940158 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:29.982556 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.982526 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.982761 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.982563 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.982761 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.982595 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.982761 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.982628 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.982761 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.982657 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.982761 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.982705 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.982761 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.982727 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.983104 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.982856 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.983104 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.982890 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4ckp\" (UniqueName: \"kubernetes.io/projected/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-kube-api-access-t4ckp\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.983104 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.983039 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.983254 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.983201 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.983352 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.983321 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.983459 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.983391 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.983534 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.983514 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.985494 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.985440 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.985794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.985754 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.990954 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.990935 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4ckp\" (UniqueName: \"kubernetes.io/projected/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-kube-api-access-t4ckp\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:29.991041 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:29.990961 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b11c9607-14c8-4605-b083-2c4aaf8e2bf6-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-dmpcv\" (UID: \"b11c9607-14c8-4605-b083-2c4aaf8e2bf6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:30.047620 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:30.047590 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:30.186494 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:30.186465 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv"] Jul 03 19:19:30.188667 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:19:30.188638 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11c9607_14c8_4605_b083_2c4aaf8e2bf6.slice/crio-a6cfc056e8f717a9c9219e18a4f9a7244b9c7e88825b01e31200b74935f195ea WatchSource:0}: Error finding container a6cfc056e8f717a9c9219e18a4f9a7244b9c7e88825b01e31200b74935f195ea: Status 404 returned error can't find the container with id a6cfc056e8f717a9c9219e18a4f9a7244b9c7e88825b01e31200b74935f195ea Jul 03 19:19:31.073390 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:31.073357 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" event={"ID":"b11c9607-14c8-4605-b083-2c4aaf8e2bf6","Type":"ContainerStarted","Data":"a6cfc056e8f717a9c9219e18a4f9a7244b9c7e88825b01e31200b74935f195ea"} Jul 03 19:19:31.680238 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:31.680184 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:31.781265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:31.781231 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:34.129022 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:34.128976 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:34.229907 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:34.229873 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:39.717073 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:39.717036 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 19:19:39.717461 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:39.717142 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 19:19:39.717461 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:39.717218 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 19:19:40.117278 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:40.117238 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" event={"ID":"b11c9607-14c8-4605-b083-2c4aaf8e2bf6","Type":"ContainerStarted","Data":"8803cbea33d54bd8bcc60203c753e65a3e53e444e7a8c743cadded59902d7325"} Jul 03 19:19:40.139239 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:40.139188 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" podStartSLOduration=1.6130261689999998 podStartE2EDuration="11.139172333s" totalImagesPullingTime="9.526146164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:19:40.137159225 +0000 UTC m=+560.284811482" watchObservedRunningTime="2026-07-03 19:19:40.139172333 +0000 UTC m=+560.286824591" Jul 03 19:19:41.047786 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.047752 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:41.052459 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.052430 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:41.122993 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.122966 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:41.123839 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.123819 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:19:41.126026 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.125999 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:41.126739 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.126723 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fpgh"] Jul 03 19:19:41.130042 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.130028 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" Jul 03 19:19:41.132139 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.132121 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4g74m\"" Jul 03 19:19:41.132139 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.132134 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 03 19:19:41.137237 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.136930 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fpgh"] Jul 03 19:19:41.220910 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.220877 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fpgh"] Jul 03 19:19:41.227823 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.227764 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:41.280380 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.280324 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:41.289511 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.289488 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94s96\" (UniqueName: \"kubernetes.io/projected/bc0609d6-6252-42de-9af4-81b09c9ac62c-kube-api-access-94s96\") pod \"limitador-limitador-64c94fd64f-2fpgh\" (UID: \"bc0609d6-6252-42de-9af4-81b09c9ac62c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" Jul 03 19:19:41.289650 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.289534 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc0609d6-6252-42de-9af4-81b09c9ac62c-config-file\") pod \"limitador-limitador-64c94fd64f-2fpgh\" (UID: \"bc0609d6-6252-42de-9af4-81b09c9ac62c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" Jul 03 19:19:41.390648 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.390562 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc0609d6-6252-42de-9af4-81b09c9ac62c-config-file\") pod \"limitador-limitador-64c94fd64f-2fpgh\" (UID: \"bc0609d6-6252-42de-9af4-81b09c9ac62c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" Jul 03 19:19:41.390648 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.390646 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94s96\" (UniqueName: \"kubernetes.io/projected/bc0609d6-6252-42de-9af4-81b09c9ac62c-kube-api-access-94s96\") pod \"limitador-limitador-64c94fd64f-2fpgh\" (UID: \"bc0609d6-6252-42de-9af4-81b09c9ac62c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" Jul 03 19:19:41.391228 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.391209 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc0609d6-6252-42de-9af4-81b09c9ac62c-config-file\") pod \"limitador-limitador-64c94fd64f-2fpgh\" (UID: \"bc0609d6-6252-42de-9af4-81b09c9ac62c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" Jul 03 19:19:41.398500 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.398476 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94s96\" (UniqueName: \"kubernetes.io/projected/bc0609d6-6252-42de-9af4-81b09c9ac62c-kube-api-access-94s96\") pod \"limitador-limitador-64c94fd64f-2fpgh\" (UID: \"bc0609d6-6252-42de-9af4-81b09c9ac62c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" Jul 03 19:19:41.440764 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.440733 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" Jul 03 19:19:41.575573 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.575546 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fpgh"] Jul 03 19:19:41.577362 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:19:41.577332 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0609d6_6252_42de_9af4_81b09c9ac62c.slice/crio-342a01a37fe85a9d9065dda43fdaae1b096b9129a5238f606317093f15ac0a20 WatchSource:0}: Error finding container 342a01a37fe85a9d9065dda43fdaae1b096b9129a5238f606317093f15ac0a20: Status 404 returned error can't find the container with id 342a01a37fe85a9d9065dda43fdaae1b096b9129a5238f606317093f15ac0a20 Jul 03 19:19:41.919040 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.919009 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-fhh62"] Jul 03 19:19:41.924256 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.924233 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fhh62" Jul 03 19:19:41.926553 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.926449 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-svxt9\"" Jul 03 19:19:41.928570 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.928549 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fhh62"] Jul 03 19:19:41.948980 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:41.948955 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:42.007874 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:42.007842 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:19:42.097652 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:42.097618 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds7lh\" (UniqueName: \"kubernetes.io/projected/c2a1f00b-d6a5-4081-a297-6f5d66530d67-kube-api-access-ds7lh\") pod \"authorino-58cd955675-fhh62\" (UID: \"c2a1f00b-d6a5-4081-a297-6f5d66530d67\") " pod="kuadrant-system/authorino-58cd955675-fhh62" Jul 03 19:19:42.128930 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:42.128896 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" event={"ID":"bc0609d6-6252-42de-9af4-81b09c9ac62c","Type":"ContainerStarted","Data":"342a01a37fe85a9d9065dda43fdaae1b096b9129a5238f606317093f15ac0a20"} Jul 03 19:19:42.198845 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:42.198730 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds7lh\" (UniqueName: \"kubernetes.io/projected/c2a1f00b-d6a5-4081-a297-6f5d66530d67-kube-api-access-ds7lh\") pod \"authorino-58cd955675-fhh62\" (UID: \"c2a1f00b-d6a5-4081-a297-6f5d66530d67\") " pod="kuadrant-system/authorino-58cd955675-fhh62" Jul 03 19:19:42.206257 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:42.206228 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds7lh\" (UniqueName: \"kubernetes.io/projected/c2a1f00b-d6a5-4081-a297-6f5d66530d67-kube-api-access-ds7lh\") pod \"authorino-58cd955675-fhh62\" (UID: \"c2a1f00b-d6a5-4081-a297-6f5d66530d67\") " pod="kuadrant-system/authorino-58cd955675-fhh62" Jul 03 19:19:42.236172 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:42.236147 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fhh62" Jul 03 19:19:42.365915 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:42.365890 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fhh62"] Jul 03 19:19:42.368453 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:19:42.368424 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2a1f00b_d6a5_4081_a297_6f5d66530d67.slice/crio-7a87dd8b04b9f2d41fd35c5aa8f3cabd6f1847872476c4083aa36037f70460a2 WatchSource:0}: Error finding container 7a87dd8b04b9f2d41fd35c5aa8f3cabd6f1847872476c4083aa36037f70460a2: Status 404 returned error can't find the container with id 7a87dd8b04b9f2d41fd35c5aa8f3cabd6f1847872476c4083aa36037f70460a2 Jul 03 19:19:43.141035 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:43.140970 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fhh62" event={"ID":"c2a1f00b-d6a5-4081-a297-6f5d66530d67","Type":"ContainerStarted","Data":"7a87dd8b04b9f2d41fd35c5aa8f3cabd6f1847872476c4083aa36037f70460a2"} Jul 03 19:19:47.163401 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:47.163360 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" event={"ID":"bc0609d6-6252-42de-9af4-81b09c9ac62c","Type":"ContainerStarted","Data":"431c3ab6e226dffe8a37125a6b711aa04249d1eafbc221c5ff8d0b7059b94db8"} Jul 03 19:19:47.163892 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:47.163481 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" Jul 03 19:19:47.164875 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:47.164846 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fhh62" event={"ID":"c2a1f00b-d6a5-4081-a297-6f5d66530d67","Type":"ContainerStarted","Data":"73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524"} Jul 03 19:19:47.179362 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:47.179312 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" podStartSLOduration=1.348640679 podStartE2EDuration="6.179296886s" totalImagesPullingTime="4.830656207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:19:47.178887335 +0000 UTC m=+567.326539628" watchObservedRunningTime="2026-07-03 19:19:47.179296886 +0000 UTC m=+567.326949172" Jul 03 19:19:47.193834 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:47.193765 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-fhh62" podStartSLOduration=2.108049344 podStartE2EDuration="6.193749889s" totalImagesPullingTime="4.085700545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:19:47.192648624 +0000 UTC m=+567.340300882" watchObservedRunningTime="2026-07-03 19:19:47.193749889 +0000 UTC m=+567.341402146" Jul 03 19:19:47.397188 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:47.397148 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fhh62"] Jul 03 19:19:49.173078 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:49.173037 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-fhh62" podUID="c2a1f00b-d6a5-4081-a297-6f5d66530d67" containerName="authorino" containerID="cri-o://73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524" gracePeriod=30 Jul 03 19:19:49.423265 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:49.423199 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fhh62" Jul 03 19:19:49.572593 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:49.572555 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds7lh\" (UniqueName: \"kubernetes.io/projected/c2a1f00b-d6a5-4081-a297-6f5d66530d67-kube-api-access-ds7lh\") pod \"c2a1f00b-d6a5-4081-a297-6f5d66530d67\" (UID: \"c2a1f00b-d6a5-4081-a297-6f5d66530d67\") " Jul 03 19:19:49.574722 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:49.574699 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2a1f00b-d6a5-4081-a297-6f5d66530d67-kube-api-access-ds7lh" (OuterVolumeSpecName: "kube-api-access-ds7lh") pod "c2a1f00b-d6a5-4081-a297-6f5d66530d67" (UID: "c2a1f00b-d6a5-4081-a297-6f5d66530d67"). InnerVolumeSpecName "kube-api-access-ds7lh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:19:49.674016 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:49.673920 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds7lh\" (UniqueName: \"kubernetes.io/projected/c2a1f00b-d6a5-4081-a297-6f5d66530d67-kube-api-access-ds7lh\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:19:50.178723 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:50.178689 2587 generic.go:356] "Generic (PLEG): container finished" podID="c2a1f00b-d6a5-4081-a297-6f5d66530d67" containerID="73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524" exitCode=0 Jul 03 19:19:50.179179 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:50.178730 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fhh62" Jul 03 19:19:50.179179 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:50.178745 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fhh62" event={"ID":"c2a1f00b-d6a5-4081-a297-6f5d66530d67","Type":"ContainerDied","Data":"73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524"} Jul 03 19:19:50.179179 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:50.178800 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fhh62" event={"ID":"c2a1f00b-d6a5-4081-a297-6f5d66530d67","Type":"ContainerDied","Data":"7a87dd8b04b9f2d41fd35c5aa8f3cabd6f1847872476c4083aa36037f70460a2"} Jul 03 19:19:50.179179 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:50.178819 2587 scope.go:117] "RemoveContainer" containerID="73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524" Jul 03 19:19:50.188078 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:50.188061 2587 scope.go:117] "RemoveContainer" containerID="73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524" Jul 03 19:19:50.188364 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:19:50.188344 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524\": container with ID starting with 73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524 not found: ID does not exist" containerID="73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524" Jul 03 19:19:50.188407 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:50.188374 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524"} err="failed to get container status \"73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524\": rpc error: code = NotFound desc = could not find container \"73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524\": container with ID starting with 73782847e330fee36348ce9c1bb736bc731ad2ecc245f05c67cef9fb0a2c9524 not found: ID does not exist" Jul 03 19:19:50.199090 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:50.199058 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fhh62"] Jul 03 19:19:50.202949 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:50.202925 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-fhh62"] Jul 03 19:19:51.445624 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:51.445591 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2a1f00b-d6a5-4081-a297-6f5d66530d67" path="/var/lib/kubelet/pods/c2a1f00b-d6a5-4081-a297-6f5d66530d67/volumes" Jul 03 19:19:58.170157 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:58.170129 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" Jul 03 19:19:58.390017 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:58.389983 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fpgh"] Jul 03 19:19:58.390212 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:58.390189 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" podUID="bc0609d6-6252-42de-9af4-81b09c9ac62c" containerName="limitador" containerID="cri-o://431c3ab6e226dffe8a37125a6b711aa04249d1eafbc221c5ff8d0b7059b94db8" gracePeriod=30 Jul 03 19:19:59.222511 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:59.222477 2587 generic.go:356] "Generic (PLEG): container finished" podID="bc0609d6-6252-42de-9af4-81b09c9ac62c" containerID="431c3ab6e226dffe8a37125a6b711aa04249d1eafbc221c5ff8d0b7059b94db8" exitCode=0 Jul 03 19:19:59.222907 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:59.222542 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" event={"ID":"bc0609d6-6252-42de-9af4-81b09c9ac62c","Type":"ContainerDied","Data":"431c3ab6e226dffe8a37125a6b711aa04249d1eafbc221c5ff8d0b7059b94db8"} Jul 03 19:19:59.338583 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:59.338561 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" Jul 03 19:19:59.362020 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:59.361993 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94s96\" (UniqueName: \"kubernetes.io/projected/bc0609d6-6252-42de-9af4-81b09c9ac62c-kube-api-access-94s96\") pod \"bc0609d6-6252-42de-9af4-81b09c9ac62c\" (UID: \"bc0609d6-6252-42de-9af4-81b09c9ac62c\") " Jul 03 19:19:59.362168 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:59.362075 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc0609d6-6252-42de-9af4-81b09c9ac62c-config-file\") pod \"bc0609d6-6252-42de-9af4-81b09c9ac62c\" (UID: \"bc0609d6-6252-42de-9af4-81b09c9ac62c\") " Jul 03 19:19:59.362435 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:59.362412 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc0609d6-6252-42de-9af4-81b09c9ac62c-config-file" (OuterVolumeSpecName: "config-file") pod "bc0609d6-6252-42de-9af4-81b09c9ac62c" (UID: "bc0609d6-6252-42de-9af4-81b09c9ac62c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 19:19:59.364143 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:59.364118 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0609d6-6252-42de-9af4-81b09c9ac62c-kube-api-access-94s96" (OuterVolumeSpecName: "kube-api-access-94s96") pod "bc0609d6-6252-42de-9af4-81b09c9ac62c" (UID: "bc0609d6-6252-42de-9af4-81b09c9ac62c"). InnerVolumeSpecName "kube-api-access-94s96". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:19:59.463430 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:59.463362 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94s96\" (UniqueName: \"kubernetes.io/projected/bc0609d6-6252-42de-9af4-81b09c9ac62c-kube-api-access-94s96\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:19:59.463430 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:19:59.463384 2587 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc0609d6-6252-42de-9af4-81b09c9ac62c-config-file\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:20:00.228926 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:00.228885 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" event={"ID":"bc0609d6-6252-42de-9af4-81b09c9ac62c","Type":"ContainerDied","Data":"342a01a37fe85a9d9065dda43fdaae1b096b9129a5238f606317093f15ac0a20"} Jul 03 19:20:00.228926 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:00.228903 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2fpgh" Jul 03 19:20:00.229437 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:00.228957 2587 scope.go:117] "RemoveContainer" containerID="431c3ab6e226dffe8a37125a6b711aa04249d1eafbc221c5ff8d0b7059b94db8" Jul 03 19:20:00.244463 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:00.244438 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fpgh"] Jul 03 19:20:00.247918 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:00.247895 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2fpgh"] Jul 03 19:20:01.445892 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:01.445859 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc0609d6-6252-42de-9af4-81b09c9ac62c" path="/var/lib/kubelet/pods/bc0609d6-6252-42de-9af4-81b09c9ac62c/volumes" Jul 03 19:20:02.656803 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.656748 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-4tgnm"] Jul 03 19:20:02.657923 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.657891 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2a1f00b-d6a5-4081-a297-6f5d66530d67" containerName="authorino" Jul 03 19:20:02.657923 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.657921 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2a1f00b-d6a5-4081-a297-6f5d66530d67" containerName="authorino" Jul 03 19:20:02.658140 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.657946 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0609d6-6252-42de-9af4-81b09c9ac62c" containerName="limitador" Jul 03 19:20:02.658140 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.657958 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0609d6-6252-42de-9af4-81b09c9ac62c" containerName="limitador" Jul 03 19:20:02.658140 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.658057 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc0609d6-6252-42de-9af4-81b09c9ac62c" containerName="limitador" Jul 03 19:20:02.658140 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.658068 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2a1f00b-d6a5-4081-a297-6f5d66530d67" containerName="authorino" Jul 03 19:20:02.663074 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.663047 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-4tgnm" Jul 03 19:20:02.665258 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.665234 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nrx98\"" Jul 03 19:20:02.665389 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.665234 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 03 19:20:02.668693 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.668669 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-4tgnm"] Jul 03 19:20:02.684739 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.684712 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:20:02.690940 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.690916 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvzbf\" (UniqueName: \"kubernetes.io/projected/2327bef8-3886-4e6a-9f56-cc95a2adf6f6-kube-api-access-tvzbf\") pod \"postgres-69fb4594cf-4tgnm\" (UID: \"2327bef8-3886-4e6a-9f56-cc95a2adf6f6\") " pod="opendatahub/postgres-69fb4594cf-4tgnm" Jul 03 19:20:02.691063 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.690972 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2327bef8-3886-4e6a-9f56-cc95a2adf6f6-data\") pod \"postgres-69fb4594cf-4tgnm\" (UID: \"2327bef8-3886-4e6a-9f56-cc95a2adf6f6\") " pod="opendatahub/postgres-69fb4594cf-4tgnm" Jul 03 19:20:02.792322 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.792289 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2327bef8-3886-4e6a-9f56-cc95a2adf6f6-data\") pod \"postgres-69fb4594cf-4tgnm\" (UID: \"2327bef8-3886-4e6a-9f56-cc95a2adf6f6\") " pod="opendatahub/postgres-69fb4594cf-4tgnm" Jul 03 19:20:02.792507 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.792367 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvzbf\" (UniqueName: \"kubernetes.io/projected/2327bef8-3886-4e6a-9f56-cc95a2adf6f6-kube-api-access-tvzbf\") pod \"postgres-69fb4594cf-4tgnm\" (UID: \"2327bef8-3886-4e6a-9f56-cc95a2adf6f6\") " pod="opendatahub/postgres-69fb4594cf-4tgnm" Jul 03 19:20:02.792665 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.792647 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2327bef8-3886-4e6a-9f56-cc95a2adf6f6-data\") pod \"postgres-69fb4594cf-4tgnm\" (UID: \"2327bef8-3886-4e6a-9f56-cc95a2adf6f6\") " pod="opendatahub/postgres-69fb4594cf-4tgnm" Jul 03 19:20:02.802544 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.802511 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvzbf\" (UniqueName: \"kubernetes.io/projected/2327bef8-3886-4e6a-9f56-cc95a2adf6f6-kube-api-access-tvzbf\") pod \"postgres-69fb4594cf-4tgnm\" (UID: \"2327bef8-3886-4e6a-9f56-cc95a2adf6f6\") " pod="opendatahub/postgres-69fb4594cf-4tgnm" Jul 03 19:20:02.975009 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:02.974909 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-4tgnm" Jul 03 19:20:03.129502 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:03.129477 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-4tgnm"] Jul 03 19:20:03.132205 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:20:03.132157 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2327bef8_3886_4e6a_9f56_cc95a2adf6f6.slice/crio-21471fd708aa52835b17858c563b4085644ff3f0e1f0b167ceeddbe59eb1bde6 WatchSource:0}: Error finding container 21471fd708aa52835b17858c563b4085644ff3f0e1f0b167ceeddbe59eb1bde6: Status 404 returned error can't find the container with id 21471fd708aa52835b17858c563b4085644ff3f0e1f0b167ceeddbe59eb1bde6 Jul 03 19:20:03.245813 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:03.245696 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-4tgnm" event={"ID":"2327bef8-3886-4e6a-9f56-cc95a2adf6f6","Type":"ContainerStarted","Data":"21471fd708aa52835b17858c563b4085644ff3f0e1f0b167ceeddbe59eb1bde6"} Jul 03 19:20:27.886889 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:27.886859 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 03 19:20:28.371000 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:28.370965 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-4tgnm" event={"ID":"2327bef8-3886-4e6a-9f56-cc95a2adf6f6","Type":"ContainerStarted","Data":"f99bb8bbd2f1fef3932bb3eff1c40f347044f39ce6f34700f903944de95d313f"} Jul 03 19:20:28.371186 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:28.371107 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-4tgnm" Jul 03 19:20:28.385483 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:28.385434 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-4tgnm" podStartSLOduration=1.6350095759999999 podStartE2EDuration="26.385420473s" totalImagesPullingTime="24.750410897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:20:28.38511441 +0000 UTC m=+608.532766690" watchObservedRunningTime="2026-07-03 19:20:28.385420473 +0000 UTC m=+608.533072727" Jul 03 19:20:34.406439 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:34.406409 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-4tgnm" Jul 03 19:20:34.718033 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:34.717953 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:20:34.878656 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:34.878624 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:20:34.941754 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:34.941721 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n2hdz"] Jul 03 19:20:34.944172 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:34.944148 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n2hdz" Jul 03 19:20:34.946395 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:34.946369 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-svxt9\"" Jul 03 19:20:34.952161 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:34.952138 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n2hdz"] Jul 03 19:20:35.092120 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.092084 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jqtm\" (UniqueName: \"kubernetes.io/projected/f341eb3d-192b-400f-8b9a-7c9d31da2aaa-kube-api-access-5jqtm\") pod \"authorino-5d4b67c446-n2hdz\" (UID: \"f341eb3d-192b-400f-8b9a-7c9d31da2aaa\") " pod="kuadrant-system/authorino-5d4b67c446-n2hdz" Jul 03 19:20:35.192315 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.192279 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n2hdz"] Jul 03 19:20:35.192540 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:20:35.192519 2587 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-5jqtm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-n2hdz" podUID="f341eb3d-192b-400f-8b9a-7c9d31da2aaa" Jul 03 19:20:35.192581 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.192563 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jqtm\" (UniqueName: \"kubernetes.io/projected/f341eb3d-192b-400f-8b9a-7c9d31da2aaa-kube-api-access-5jqtm\") pod \"authorino-5d4b67c446-n2hdz\" (UID: \"f341eb3d-192b-400f-8b9a-7c9d31da2aaa\") " pod="kuadrant-system/authorino-5d4b67c446-n2hdz" Jul 03 19:20:35.210277 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.210247 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jqtm\" (UniqueName: \"kubernetes.io/projected/f341eb3d-192b-400f-8b9a-7c9d31da2aaa-kube-api-access-5jqtm\") pod \"authorino-5d4b67c446-n2hdz\" (UID: \"f341eb3d-192b-400f-8b9a-7c9d31da2aaa\") " pod="kuadrant-system/authorino-5d4b67c446-n2hdz" Jul 03 19:20:35.351132 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.351053 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64bbdcc5-f2kkg"] Jul 03 19:20:35.353462 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.353446 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64bbdcc5-f2kkg" Jul 03 19:20:35.355809 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.355759 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 03 19:20:35.362545 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.362515 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64bbdcc5-f2kkg"] Jul 03 19:20:35.404742 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.404711 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n2hdz" Jul 03 19:20:35.410136 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.410117 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n2hdz" Jul 03 19:20:35.496227 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.496190 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5c164cb-37da-49cd-a23d-f44cec936fd2-tls-cert\") pod \"authorino-64bbdcc5-f2kkg\" (UID: \"b5c164cb-37da-49cd-a23d-f44cec936fd2\") " pod="kuadrant-system/authorino-64bbdcc5-f2kkg" Jul 03 19:20:35.496418 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.496303 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z4pl\" (UniqueName: \"kubernetes.io/projected/b5c164cb-37da-49cd-a23d-f44cec936fd2-kube-api-access-6z4pl\") pod \"authorino-64bbdcc5-f2kkg\" (UID: \"b5c164cb-37da-49cd-a23d-f44cec936fd2\") " pod="kuadrant-system/authorino-64bbdcc5-f2kkg" Jul 03 19:20:35.597267 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.597232 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jqtm\" (UniqueName: \"kubernetes.io/projected/f341eb3d-192b-400f-8b9a-7c9d31da2aaa-kube-api-access-5jqtm\") pod \"f341eb3d-192b-400f-8b9a-7c9d31da2aaa\" (UID: \"f341eb3d-192b-400f-8b9a-7c9d31da2aaa\") " Jul 03 19:20:35.597438 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.597365 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z4pl\" (UniqueName: \"kubernetes.io/projected/b5c164cb-37da-49cd-a23d-f44cec936fd2-kube-api-access-6z4pl\") pod \"authorino-64bbdcc5-f2kkg\" (UID: \"b5c164cb-37da-49cd-a23d-f44cec936fd2\") " pod="kuadrant-system/authorino-64bbdcc5-f2kkg" Jul 03 19:20:35.597438 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.597411 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5c164cb-37da-49cd-a23d-f44cec936fd2-tls-cert\") pod \"authorino-64bbdcc5-f2kkg\" (UID: \"b5c164cb-37da-49cd-a23d-f44cec936fd2\") " pod="kuadrant-system/authorino-64bbdcc5-f2kkg" Jul 03 19:20:35.599409 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.599381 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f341eb3d-192b-400f-8b9a-7c9d31da2aaa-kube-api-access-5jqtm" (OuterVolumeSpecName: "kube-api-access-5jqtm") pod "f341eb3d-192b-400f-8b9a-7c9d31da2aaa" (UID: "f341eb3d-192b-400f-8b9a-7c9d31da2aaa"). InnerVolumeSpecName "kube-api-access-5jqtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:20:35.599763 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.599743 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5c164cb-37da-49cd-a23d-f44cec936fd2-tls-cert\") pod \"authorino-64bbdcc5-f2kkg\" (UID: \"b5c164cb-37da-49cd-a23d-f44cec936fd2\") " pod="kuadrant-system/authorino-64bbdcc5-f2kkg" Jul 03 19:20:35.604667 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.604616 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z4pl\" (UniqueName: \"kubernetes.io/projected/b5c164cb-37da-49cd-a23d-f44cec936fd2-kube-api-access-6z4pl\") pod \"authorino-64bbdcc5-f2kkg\" (UID: \"b5c164cb-37da-49cd-a23d-f44cec936fd2\") " pod="kuadrant-system/authorino-64bbdcc5-f2kkg" Jul 03 19:20:35.663693 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.663657 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64bbdcc5-f2kkg" Jul 03 19:20:35.699127 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.699093 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jqtm\" (UniqueName: \"kubernetes.io/projected/f341eb3d-192b-400f-8b9a-7c9d31da2aaa-kube-api-access-5jqtm\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:20:35.793312 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:35.793288 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64bbdcc5-f2kkg"] Jul 03 19:20:35.795307 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:20:35.795287 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5c164cb_37da_49cd_a23d_f44cec936fd2.slice/crio-3c8234ec8dce67ff99d0fb748d59da89dc476ba0f552a94c73dfdcb9b99093f7 WatchSource:0}: Error finding container 3c8234ec8dce67ff99d0fb748d59da89dc476ba0f552a94c73dfdcb9b99093f7: Status 404 returned error can't find the container with id 3c8234ec8dce67ff99d0fb748d59da89dc476ba0f552a94c73dfdcb9b99093f7 Jul 03 19:20:36.410979 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:36.410892 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-n2hdz" Jul 03 19:20:36.410979 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:36.410918 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64bbdcc5-f2kkg" event={"ID":"b5c164cb-37da-49cd-a23d-f44cec936fd2","Type":"ContainerStarted","Data":"17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635"} Jul 03 19:20:36.410979 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:36.410956 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64bbdcc5-f2kkg" event={"ID":"b5c164cb-37da-49cd-a23d-f44cec936fd2","Type":"ContainerStarted","Data":"3c8234ec8dce67ff99d0fb748d59da89dc476ba0f552a94c73dfdcb9b99093f7"} Jul 03 19:20:36.425385 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:36.425332 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64bbdcc5-f2kkg" podStartSLOduration=1.12625776 podStartE2EDuration="1.425316599s" totalImagesPullingTime="299.058839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:20:36.42438738 +0000 UTC m=+616.572039639" watchObservedRunningTime="2026-07-03 19:20:36.425316599 +0000 UTC m=+616.572968857" Jul 03 19:20:36.454338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:36.454306 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n2hdz"] Jul 03 19:20:36.458071 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:36.458046 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-n2hdz"] Jul 03 19:20:37.445651 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:37.445622 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f341eb3d-192b-400f-8b9a-7c9d31da2aaa" path="/var/lib/kubelet/pods/f341eb3d-192b-400f-8b9a-7c9d31da2aaa/volumes" Jul 03 19:20:40.599335 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.599302 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:20:40.606729 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.606687 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6df76fdcd8-jj6mz"] Jul 03 19:20:40.623743 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.623711 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6df76fdcd8-jj6mz"] Jul 03 19:20:40.623932 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.623849 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" Jul 03 19:20:40.626103 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.626075 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 03 19:20:40.626252 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.626105 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 03 19:20:40.626252 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.626118 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7rdmp\"" Jul 03 19:20:40.644133 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.644103 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef18a419-2f3f-48e0-9c8a-11ac9932d250-webhook-cert\") pod \"maas-controller-6df76fdcd8-jj6mz\" (UID: \"ef18a419-2f3f-48e0-9c8a-11ac9932d250\") " pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" Jul 03 19:20:40.644257 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.644151 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h4gn\" (UniqueName: \"kubernetes.io/projected/ef18a419-2f3f-48e0-9c8a-11ac9932d250-kube-api-access-4h4gn\") pod \"maas-controller-6df76fdcd8-jj6mz\" (UID: \"ef18a419-2f3f-48e0-9c8a-11ac9932d250\") " pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" Jul 03 19:20:40.699026 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.698990 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:20:40.745109 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.745056 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h4gn\" (UniqueName: \"kubernetes.io/projected/ef18a419-2f3f-48e0-9c8a-11ac9932d250-kube-api-access-4h4gn\") pod \"maas-controller-6df76fdcd8-jj6mz\" (UID: \"ef18a419-2f3f-48e0-9c8a-11ac9932d250\") " pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" Jul 03 19:20:40.745301 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.745172 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef18a419-2f3f-48e0-9c8a-11ac9932d250-webhook-cert\") pod \"maas-controller-6df76fdcd8-jj6mz\" (UID: \"ef18a419-2f3f-48e0-9c8a-11ac9932d250\") " pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" Jul 03 19:20:40.747573 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.747544 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef18a419-2f3f-48e0-9c8a-11ac9932d250-webhook-cert\") pod \"maas-controller-6df76fdcd8-jj6mz\" (UID: \"ef18a419-2f3f-48e0-9c8a-11ac9932d250\") " pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" Jul 03 19:20:40.755239 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.755216 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h4gn\" (UniqueName: \"kubernetes.io/projected/ef18a419-2f3f-48e0-9c8a-11ac9932d250-kube-api-access-4h4gn\") pod \"maas-controller-6df76fdcd8-jj6mz\" (UID: \"ef18a419-2f3f-48e0-9c8a-11ac9932d250\") " pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" Jul 03 19:20:40.774919 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.774890 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:20:40.779103 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.779076 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8689fb654f-65mz9"] Jul 03 19:20:40.782021 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.782002 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8689fb654f-65mz9" Jul 03 19:20:40.793499 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.793468 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8689fb654f-65mz9"] Jul 03 19:20:40.846090 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.846048 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cm2t\" (UniqueName: \"kubernetes.io/projected/a7982782-1f2f-4ac3-b538-fd09f9b12335-kube-api-access-4cm2t\") pod \"maas-controller-8689fb654f-65mz9\" (UID: \"a7982782-1f2f-4ac3-b538-fd09f9b12335\") " pod="opendatahub/maas-controller-8689fb654f-65mz9" Jul 03 19:20:40.846090 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.846091 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7982782-1f2f-4ac3-b538-fd09f9b12335-webhook-cert\") pod \"maas-controller-8689fb654f-65mz9\" (UID: \"a7982782-1f2f-4ac3-b538-fd09f9b12335\") " pod="opendatahub/maas-controller-8689fb654f-65mz9" Jul 03 19:20:40.936540 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.936447 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" Jul 03 19:20:40.947473 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.947442 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cm2t\" (UniqueName: \"kubernetes.io/projected/a7982782-1f2f-4ac3-b538-fd09f9b12335-kube-api-access-4cm2t\") pod \"maas-controller-8689fb654f-65mz9\" (UID: \"a7982782-1f2f-4ac3-b538-fd09f9b12335\") " pod="opendatahub/maas-controller-8689fb654f-65mz9" Jul 03 19:20:40.947620 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.947489 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7982782-1f2f-4ac3-b538-fd09f9b12335-webhook-cert\") pod \"maas-controller-8689fb654f-65mz9\" (UID: \"a7982782-1f2f-4ac3-b538-fd09f9b12335\") " pod="opendatahub/maas-controller-8689fb654f-65mz9" Jul 03 19:20:40.949952 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.949927 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7982782-1f2f-4ac3-b538-fd09f9b12335-webhook-cert\") pod \"maas-controller-8689fb654f-65mz9\" (UID: \"a7982782-1f2f-4ac3-b538-fd09f9b12335\") " pod="opendatahub/maas-controller-8689fb654f-65mz9" Jul 03 19:20:40.956082 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:40.956058 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cm2t\" (UniqueName: \"kubernetes.io/projected/a7982782-1f2f-4ac3-b538-fd09f9b12335-kube-api-access-4cm2t\") pod \"maas-controller-8689fb654f-65mz9\" (UID: \"a7982782-1f2f-4ac3-b538-fd09f9b12335\") " pod="opendatahub/maas-controller-8689fb654f-65mz9" Jul 03 19:20:41.071595 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:41.071573 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6df76fdcd8-jj6mz"] Jul 03 19:20:41.073304 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:20:41.073266 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef18a419_2f3f_48e0_9c8a_11ac9932d250.slice/crio-2e43cd82aa42a2cc9af0a5623eefdce732f94d8522e88bfd22aca08dc2eef4f2 WatchSource:0}: Error finding container 2e43cd82aa42a2cc9af0a5623eefdce732f94d8522e88bfd22aca08dc2eef4f2: Status 404 returned error can't find the container with id 2e43cd82aa42a2cc9af0a5623eefdce732f94d8522e88bfd22aca08dc2eef4f2 Jul 03 19:20:41.093454 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:41.093433 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8689fb654f-65mz9" Jul 03 19:20:41.226545 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:41.226495 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8689fb654f-65mz9"] Jul 03 19:20:41.228868 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:20:41.228846 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7982782_1f2f_4ac3_b538_fd09f9b12335.slice/crio-980fecbcef32d6e9d1ef70c8725a127ed06396c9e8873e3964630197eac1395c WatchSource:0}: Error finding container 980fecbcef32d6e9d1ef70c8725a127ed06396c9e8873e3964630197eac1395c: Status 404 returned error can't find the container with id 980fecbcef32d6e9d1ef70c8725a127ed06396c9e8873e3964630197eac1395c Jul 03 19:20:41.445636 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:41.445600 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8689fb654f-65mz9" event={"ID":"a7982782-1f2f-4ac3-b538-fd09f9b12335","Type":"ContainerStarted","Data":"980fecbcef32d6e9d1ef70c8725a127ed06396c9e8873e3964630197eac1395c"} Jul 03 19:20:41.445816 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:41.445652 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" event={"ID":"ef18a419-2f3f-48e0-9c8a-11ac9932d250","Type":"ContainerStarted","Data":"2e43cd82aa42a2cc9af0a5623eefdce732f94d8522e88bfd22aca08dc2eef4f2"} Jul 03 19:20:43.467266 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:43.467225 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8689fb654f-65mz9" event={"ID":"a7982782-1f2f-4ac3-b538-fd09f9b12335","Type":"ContainerStarted","Data":"e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183"} Jul 03 19:20:43.467811 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:43.467428 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8689fb654f-65mz9" Jul 03 19:20:43.469267 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:43.469246 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" event={"ID":"ef18a419-2f3f-48e0-9c8a-11ac9932d250","Type":"ContainerStarted","Data":"70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a"} Jul 03 19:20:43.469377 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:43.469366 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" Jul 03 19:20:43.520594 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:43.520502 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:20:43.520866 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:43.520812 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8689fb654f-65mz9" podStartSLOduration=1.49284665 podStartE2EDuration="3.520793853s" totalImagesPullingTime="2.027947203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:20:43.51794972 +0000 UTC m=+623.665601979" watchObservedRunningTime="2026-07-03 19:20:43.520793853 +0000 UTC m=+623.668446110" Jul 03 19:20:43.547020 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:43.546963 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" podStartSLOduration=1.37389671 podStartE2EDuration="3.546945561s" totalImagesPullingTime="2.173048851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:20:43.546340868 +0000 UTC m=+623.693993152" watchObservedRunningTime="2026-07-03 19:20:43.546945561 +0000 UTC m=+623.694597818" Jul 03 19:20:43.645476 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:43.645441 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:20:54.480232 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:54.480202 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8689fb654f-65mz9" Jul 03 19:20:54.480632 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:54.480281 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" Jul 03 19:20:54.539862 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:54.539827 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6df76fdcd8-jj6mz"] Jul 03 19:20:54.540083 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:54.540056 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" podUID="ef18a419-2f3f-48e0-9c8a-11ac9932d250" containerName="manager" containerID="cri-o://70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a" gracePeriod=30 Jul 03 19:20:54.810831 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:54.810799 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" Jul 03 19:20:54.881156 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:54.881123 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h4gn\" (UniqueName: \"kubernetes.io/projected/ef18a419-2f3f-48e0-9c8a-11ac9932d250-kube-api-access-4h4gn\") pod \"ef18a419-2f3f-48e0-9c8a-11ac9932d250\" (UID: \"ef18a419-2f3f-48e0-9c8a-11ac9932d250\") " Jul 03 19:20:54.881325 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:54.881205 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef18a419-2f3f-48e0-9c8a-11ac9932d250-webhook-cert\") pod \"ef18a419-2f3f-48e0-9c8a-11ac9932d250\" (UID: \"ef18a419-2f3f-48e0-9c8a-11ac9932d250\") " Jul 03 19:20:54.883366 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:54.883340 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef18a419-2f3f-48e0-9c8a-11ac9932d250-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ef18a419-2f3f-48e0-9c8a-11ac9932d250" (UID: "ef18a419-2f3f-48e0-9c8a-11ac9932d250"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:20:54.883462 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:54.883441 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef18a419-2f3f-48e0-9c8a-11ac9932d250-kube-api-access-4h4gn" (OuterVolumeSpecName: "kube-api-access-4h4gn") pod "ef18a419-2f3f-48e0-9c8a-11ac9932d250" (UID: "ef18a419-2f3f-48e0-9c8a-11ac9932d250"). InnerVolumeSpecName "kube-api-access-4h4gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:20:54.982749 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:54.982705 2587 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef18a419-2f3f-48e0-9c8a-11ac9932d250-webhook-cert\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:20:54.982749 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:54.982744 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h4gn\" (UniqueName: \"kubernetes.io/projected/ef18a419-2f3f-48e0-9c8a-11ac9932d250-kube-api-access-4h4gn\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:20:55.534337 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:55.534298 2587 generic.go:356] "Generic (PLEG): container finished" podID="ef18a419-2f3f-48e0-9c8a-11ac9932d250" containerID="70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a" exitCode=0 Jul 03 19:20:55.534864 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:55.534361 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" event={"ID":"ef18a419-2f3f-48e0-9c8a-11ac9932d250","Type":"ContainerDied","Data":"70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a"} Jul 03 19:20:55.534864 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:55.534373 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" Jul 03 19:20:55.534864 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:55.534410 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6df76fdcd8-jj6mz" event={"ID":"ef18a419-2f3f-48e0-9c8a-11ac9932d250","Type":"ContainerDied","Data":"2e43cd82aa42a2cc9af0a5623eefdce732f94d8522e88bfd22aca08dc2eef4f2"} Jul 03 19:20:55.534864 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:55.534439 2587 scope.go:117] "RemoveContainer" containerID="70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a" Jul 03 19:20:55.551612 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:55.551585 2587 scope.go:117] "RemoveContainer" containerID="70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a" Jul 03 19:20:55.552293 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:20:55.552259 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a\": container with ID starting with 70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a not found: ID does not exist" containerID="70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a" Jul 03 19:20:55.552403 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:55.552305 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a"} err="failed to get container status \"70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a\": rpc error: code = NotFound desc = could not find container \"70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a\": container with ID starting with 70e6535440def11db141152fc76bd20569fa7b933952ca7f666e289472263f6a not found: ID does not exist" Jul 03 19:20:55.559665 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:55.559638 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6df76fdcd8-jj6mz"] Jul 03 19:20:55.564508 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:55.564478 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6df76fdcd8-jj6mz"] Jul 03 19:20:57.446819 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:20:57.446789 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef18a419-2f3f-48e0-9c8a-11ac9932d250" path="/var/lib/kubelet/pods/ef18a419-2f3f-48e0-9c8a-11ac9932d250/volumes" Jul 03 19:21:15.798663 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:15.798626 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:21:16.357002 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.356973 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6b8cb6fc6-nvnpv"] Jul 03 19:21:16.357378 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.357365 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef18a419-2f3f-48e0-9c8a-11ac9932d250" containerName="manager" Jul 03 19:21:16.357428 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.357379 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef18a419-2f3f-48e0-9c8a-11ac9932d250" containerName="manager" Jul 03 19:21:16.357475 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.357448 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef18a419-2f3f-48e0-9c8a-11ac9932d250" containerName="manager" Jul 03 19:21:16.361897 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.361869 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:16.364126 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.364098 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 03 19:21:16.364241 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.364145 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t7rd4\"" Jul 03 19:21:16.372477 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.372454 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b8cb6fc6-nvnpv"] Jul 03 19:21:16.482203 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.482171 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq8zw\" (UniqueName: \"kubernetes.io/projected/90270640-b967-47cf-b825-d611623ee17b-kube-api-access-jq8zw\") pod \"maas-api-6b8cb6fc6-nvnpv\" (UID: \"90270640-b967-47cf-b825-d611623ee17b\") " pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:16.482375 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.482216 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90270640-b967-47cf-b825-d611623ee17b-maas-api-tls\") pod \"maas-api-6b8cb6fc6-nvnpv\" (UID: \"90270640-b967-47cf-b825-d611623ee17b\") " pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:16.482375 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.482245 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90270640-b967-47cf-b825-d611623ee17b-openshift-service-ca\") pod \"maas-api-6b8cb6fc6-nvnpv\" (UID: \"90270640-b967-47cf-b825-d611623ee17b\") " pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:16.583523 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.583478 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90270640-b967-47cf-b825-d611623ee17b-maas-api-tls\") pod \"maas-api-6b8cb6fc6-nvnpv\" (UID: \"90270640-b967-47cf-b825-d611623ee17b\") " pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:16.583735 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.583536 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90270640-b967-47cf-b825-d611623ee17b-openshift-service-ca\") pod \"maas-api-6b8cb6fc6-nvnpv\" (UID: \"90270640-b967-47cf-b825-d611623ee17b\") " pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:16.583847 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.583749 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq8zw\" (UniqueName: \"kubernetes.io/projected/90270640-b967-47cf-b825-d611623ee17b-kube-api-access-jq8zw\") pod \"maas-api-6b8cb6fc6-nvnpv\" (UID: \"90270640-b967-47cf-b825-d611623ee17b\") " pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:16.584528 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.584505 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90270640-b967-47cf-b825-d611623ee17b-openshift-service-ca\") pod \"maas-api-6b8cb6fc6-nvnpv\" (UID: \"90270640-b967-47cf-b825-d611623ee17b\") " pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:16.586112 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.586087 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90270640-b967-47cf-b825-d611623ee17b-maas-api-tls\") pod \"maas-api-6b8cb6fc6-nvnpv\" (UID: \"90270640-b967-47cf-b825-d611623ee17b\") " pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:16.593266 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.593245 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq8zw\" (UniqueName: \"kubernetes.io/projected/90270640-b967-47cf-b825-d611623ee17b-kube-api-access-jq8zw\") pod \"maas-api-6b8cb6fc6-nvnpv\" (UID: \"90270640-b967-47cf-b825-d611623ee17b\") " pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:16.672787 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.672680 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:16.820894 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.820689 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b8cb6fc6-nvnpv"] Jul 03 19:21:16.824260 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:21:16.824223 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90270640_b967_47cf_b825_d611623ee17b.slice/crio-d5a5d8c693dd0552ae8436212b6ce51a510c290d43e639a12df9bfa59d638faf WatchSource:0}: Error finding container d5a5d8c693dd0552ae8436212b6ce51a510c290d43e639a12df9bfa59d638faf: Status 404 returned error can't find the container with id d5a5d8c693dd0552ae8436212b6ce51a510c290d43e639a12df9bfa59d638faf Jul 03 19:21:16.826554 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.826533 2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 19:21:16.965635 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.965556 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-59h6g"] Jul 03 19:21:16.971832 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.971810 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" Jul 03 19:21:16.974243 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.974223 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 03 19:21:16.974356 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.974339 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-h7sz2\"" Jul 03 19:21:16.979702 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.979677 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-59h6g"] Jul 03 19:21:16.998963 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:16.998936 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qvr8m"] Jul 03 19:21:17.003324 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.003306 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" Jul 03 19:21:17.012446 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.012425 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qvr8m"] Jul 03 19:21:17.089567 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.089534 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:21:17.089746 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.089635 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqqkc\" (UniqueName: \"kubernetes.io/projected/78603a7e-d538-477d-8179-c8121425c885-kube-api-access-lqqkc\") pod \"payload-pre-processing-7964457696-59h6g\" (UID: \"78603a7e-d538-477d-8179-c8121425c885\") " pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" Jul 03 19:21:17.089746 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.089689 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78603a7e-d538-477d-8179-c8121425c885-plugins-config-volume\") pod \"payload-pre-processing-7964457696-59h6g\" (UID: \"78603a7e-d538-477d-8179-c8121425c885\") " pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" Jul 03 19:21:17.190942 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.190910 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bd85cf4-10bf-4159-b4cd-1e35de3fe692-plugins-config-volume\") pod \"payload-processing-58f86c7798-qvr8m\" (UID: \"7bd85cf4-10bf-4159-b4cd-1e35de3fe692\") " pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" Jul 03 19:21:17.191107 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.191040 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqqkc\" (UniqueName: \"kubernetes.io/projected/78603a7e-d538-477d-8179-c8121425c885-kube-api-access-lqqkc\") pod \"payload-pre-processing-7964457696-59h6g\" (UID: \"78603a7e-d538-477d-8179-c8121425c885\") " pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" Jul 03 19:21:17.191107 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.191087 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbr28\" (UniqueName: \"kubernetes.io/projected/7bd85cf4-10bf-4159-b4cd-1e35de3fe692-kube-api-access-nbr28\") pod \"payload-processing-58f86c7798-qvr8m\" (UID: \"7bd85cf4-10bf-4159-b4cd-1e35de3fe692\") " pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" Jul 03 19:21:17.191222 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.191126 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78603a7e-d538-477d-8179-c8121425c885-plugins-config-volume\") pod \"payload-pre-processing-7964457696-59h6g\" (UID: \"78603a7e-d538-477d-8179-c8121425c885\") " pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" Jul 03 19:21:17.191822 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.191804 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78603a7e-d538-477d-8179-c8121425c885-plugins-config-volume\") pod \"payload-pre-processing-7964457696-59h6g\" (UID: \"78603a7e-d538-477d-8179-c8121425c885\") " pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" Jul 03 19:21:17.198976 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.198954 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqqkc\" (UniqueName: \"kubernetes.io/projected/78603a7e-d538-477d-8179-c8121425c885-kube-api-access-lqqkc\") pod \"payload-pre-processing-7964457696-59h6g\" (UID: \"78603a7e-d538-477d-8179-c8121425c885\") " pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" Jul 03 19:21:17.283463 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.283382 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" Jul 03 19:21:17.292667 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.292633 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbr28\" (UniqueName: \"kubernetes.io/projected/7bd85cf4-10bf-4159-b4cd-1e35de3fe692-kube-api-access-nbr28\") pod \"payload-processing-58f86c7798-qvr8m\" (UID: \"7bd85cf4-10bf-4159-b4cd-1e35de3fe692\") " pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" Jul 03 19:21:17.292799 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.292748 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bd85cf4-10bf-4159-b4cd-1e35de3fe692-plugins-config-volume\") pod \"payload-processing-58f86c7798-qvr8m\" (UID: \"7bd85cf4-10bf-4159-b4cd-1e35de3fe692\") " pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" Jul 03 19:21:17.293420 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.293398 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7bd85cf4-10bf-4159-b4cd-1e35de3fe692-plugins-config-volume\") pod \"payload-processing-58f86c7798-qvr8m\" (UID: \"7bd85cf4-10bf-4159-b4cd-1e35de3fe692\") " pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" Jul 03 19:21:17.299982 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.299953 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbr28\" (UniqueName: \"kubernetes.io/projected/7bd85cf4-10bf-4159-b4cd-1e35de3fe692-kube-api-access-nbr28\") pod \"payload-processing-58f86c7798-qvr8m\" (UID: \"7bd85cf4-10bf-4159-b4cd-1e35de3fe692\") " pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" Jul 03 19:21:17.314925 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.314898 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" Jul 03 19:21:17.427744 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.427709 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-59h6g"] Jul 03 19:21:17.429340 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:21:17.429212 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78603a7e_d538_477d_8179_c8121425c885.slice/crio-1e21c75208c1d9635546783b41fca9fe189999d0fa1cc38d6a6ff7557131b798 WatchSource:0}: Error finding container 1e21c75208c1d9635546783b41fca9fe189999d0fa1cc38d6a6ff7557131b798: Status 404 returned error can't find the container with id 1e21c75208c1d9635546783b41fca9fe189999d0fa1cc38d6a6ff7557131b798 Jul 03 19:21:17.490153 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.490070 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qvr8m"] Jul 03 19:21:17.493163 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:21:17.493134 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd85cf4_10bf_4159_b4cd_1e35de3fe692.slice/crio-9fa0db30156c7d5421673300fb028da59438c220d3e779855b9fa1f24bc93a6b WatchSource:0}: Error finding container 9fa0db30156c7d5421673300fb028da59438c220d3e779855b9fa1f24bc93a6b: Status 404 returned error can't find the container with id 9fa0db30156c7d5421673300fb028da59438c220d3e779855b9fa1f24bc93a6b Jul 03 19:21:17.645001 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.644962 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" event={"ID":"78603a7e-d538-477d-8179-c8121425c885","Type":"ContainerStarted","Data":"1e21c75208c1d9635546783b41fca9fe189999d0fa1cc38d6a6ff7557131b798"} Jul 03 19:21:17.646408 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.646373 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" event={"ID":"90270640-b967-47cf-b825-d611623ee17b","Type":"ContainerStarted","Data":"d5a5d8c693dd0552ae8436212b6ce51a510c290d43e639a12df9bfa59d638faf"} Jul 03 19:21:17.647814 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:17.647784 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" event={"ID":"7bd85cf4-10bf-4159-b4cd-1e35de3fe692","Type":"ContainerStarted","Data":"9fa0db30156c7d5421673300fb028da59438c220d3e779855b9fa1f24bc93a6b"} Jul 03 19:21:19.662688 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:19.662646 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" event={"ID":"78603a7e-d538-477d-8179-c8121425c885","Type":"ContainerStarted","Data":"2a60122d73798a8c2ffb04fb8663158c148ad24e83570816475eb4bbd92d79c9"} Jul 03 19:21:19.663459 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:19.663437 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" Jul 03 19:21:19.665175 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:19.665147 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" event={"ID":"90270640-b967-47cf-b825-d611623ee17b","Type":"ContainerStarted","Data":"ff79febcd4b322b9a5dd088a5d7f66bfd0a3acc88153a92c559646bf0b94aa40"} Jul 03 19:21:19.665294 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:19.665235 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:19.667227 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:19.667203 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" event={"ID":"7bd85cf4-10bf-4159-b4cd-1e35de3fe692","Type":"ContainerStarted","Data":"3f44145ed20511d666d5c03761960527eb0a7034a907161e5e39c64a9e44d3b1"} Jul 03 19:21:19.667310 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:19.667292 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" Jul 03 19:21:19.678553 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:19.678515 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" podStartSLOduration=2.017987078 podStartE2EDuration="3.678502778s" totalImagesPullingTime="1.6605157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:21:19.67712509 +0000 UTC m=+659.824777347" watchObservedRunningTime="2026-07-03 19:21:19.678502778 +0000 UTC m=+659.826155036" Jul 03 19:21:19.693324 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:19.693275 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" podStartSLOduration=1.527537074 podStartE2EDuration="3.693261569s" totalImagesPullingTime="2.165724495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:21:19.691699927 +0000 UTC m=+659.839352210" watchObservedRunningTime="2026-07-03 19:21:19.693261569 +0000 UTC m=+659.840913827" Jul 03 19:21:19.705493 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:19.705452 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" podStartSLOduration=2.13306462 podStartE2EDuration="3.705437465s" totalImagesPullingTime="1.572372845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:21:19.704705069 +0000 UTC m=+659.852357330" watchObservedRunningTime="2026-07-03 19:21:19.705437465 +0000 UTC m=+659.853089743" Jul 03 19:21:25.677375 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:25.677347 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6b8cb6fc6-nvnpv" Jul 03 19:21:25.700476 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:25.700443 2587 generic.go:356] "Generic (PLEG): container finished" podID="b11c9607-14c8-4605-b083-2c4aaf8e2bf6" containerID="8803cbea33d54bd8bcc60203c753e65a3e53e444e7a8c743cadded59902d7325" exitCode=0 Jul 03 19:21:25.700673 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:25.700520 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" event={"ID":"b11c9607-14c8-4605-b083-2c4aaf8e2bf6","Type":"ContainerDied","Data":"8803cbea33d54bd8bcc60203c753e65a3e53e444e7a8c743cadded59902d7325"} Jul 03 19:21:25.700999 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:25.700982 2587 scope.go:117] "RemoveContainer" containerID="8803cbea33d54bd8bcc60203c753e65a3e53e444e7a8c743cadded59902d7325" Jul 03 19:21:25.701991 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:25.701965 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 19:21:25.702055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:25.702029 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 19:21:25.702092 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:25.702058 2587 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 03 19:21:26.123905 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:26.123871 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:21:26.657118 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:26.657067 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:21:26.710881 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:26.710853 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" event={"ID":"b11c9607-14c8-4605-b083-2c4aaf8e2bf6","Type":"ContainerStarted","Data":"f5b4ec320808d63b239f120ccc3dfc90fb91e5df7f8ad59fab6376e77c92f361"} Jul 03 19:21:26.742708 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:26.742588 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:21:27.050004 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:27.048877 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:21:27.050232 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:27.050075 2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dmpcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 03 19:21:27.050232 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:27.050148 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" podUID="b11c9607-14c8-4605-b083-2c4aaf8e2bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 03 19:21:28.048317 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:28.048286 2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dmpcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 03 19:21:28.048932 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:28.048896 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" podUID="b11c9607-14c8-4605-b083-2c4aaf8e2bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 03 19:21:29.048789 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:29.048312 2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dmpcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 03 19:21:29.048789 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:29.048382 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" podUID="b11c9607-14c8-4605-b083-2c4aaf8e2bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 03 19:21:30.048460 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:30.048419 2587 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-dmpcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 03 19:21:30.048783 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:30.048730 2587 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" podUID="b11c9607-14c8-4605-b083-2c4aaf8e2bf6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 03 19:21:30.673904 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:30.673872 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-qvr8m" Jul 03 19:21:31.052178 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:31.052151 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:21:31.052425 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:31.052402 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:21:31.053150 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:31.053133 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-dmpcv" Jul 03 19:21:31.679307 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:31.679275 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-59h6g" Jul 03 19:21:33.651848 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.651817 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn"] Jul 03 19:21:33.654758 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.654734 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.657039 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.657016 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 03 19:21:33.657209 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.657161 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 03 19:21:33.657952 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.657922 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-79k5p\"" Jul 03 19:21:33.658051 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.657961 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 03 19:21:33.666889 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.666869 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn"] Jul 03 19:21:33.687395 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.687358 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:21:33.751029 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.751003 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.751029 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.751031 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6824l\" (UniqueName: \"kubernetes.io/projected/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-kube-api-access-6824l\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.751249 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.751064 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.751249 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.751092 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.751249 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.751128 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.751249 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.751147 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.852041 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.852002 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.852231 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.852047 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.852231 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.852141 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.852231 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.852183 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6824l\" (UniqueName: \"kubernetes.io/projected/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-kube-api-access-6824l\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.852395 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.852258 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.852395 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.852303 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.852493 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.852413 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.852493 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.852454 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.852604 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.852586 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.854433 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.854413 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.854670 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.854654 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.859611 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.859588 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6824l\" (UniqueName: \"kubernetes.io/projected/0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0-kube-api-access-6824l\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn\" (UID: \"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:33.968186 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:33.968094 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:34.113203 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:34.113152 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn"] Jul 03 19:21:34.115754 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:21:34.115725 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb5ff8a_9f0c_48f9_976d_4a8f5a1485b0.slice/crio-8066978ada40f62fac20e6340a0c25daffc1e140ed4c74eee61ac5cb5c82e8c6 WatchSource:0}: Error finding container 8066978ada40f62fac20e6340a0c25daffc1e140ed4c74eee61ac5cb5c82e8c6: Status 404 returned error can't find the container with id 8066978ada40f62fac20e6340a0c25daffc1e140ed4c74eee61ac5cb5c82e8c6 Jul 03 19:21:34.758255 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:34.758214 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" event={"ID":"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0","Type":"ContainerStarted","Data":"8066978ada40f62fac20e6340a0c25daffc1e140ed4c74eee61ac5cb5c82e8c6"} Jul 03 19:21:35.765051 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:35.765009 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" event={"ID":"0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0","Type":"ContainerStarted","Data":"59bab17262cc536144ae68968a7c7607f68ea7cc40244b23b79bb9796f02979b"} Jul 03 19:21:35.782303 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:35.782256 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" podStartSLOduration=1.647803286 podStartE2EDuration="2.782240892s" totalImagesPullingTime="1.134437606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:21:35.779946064 +0000 UTC m=+675.927598323" watchObservedRunningTime="2026-07-03 19:21:35.782240892 +0000 UTC m=+675.929893219" Jul 03 19:21:41.950956 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:41.950913 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t"] Jul 03 19:21:41.954861 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:41.954836 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:41.957032 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:41.957014 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 03 19:21:41.965731 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:41.965704 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t"] Jul 03 19:21:41.996156 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:41.996128 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:21:42.034191 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.034163 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2207f68-1e2a-4ace-a900-0c9ed27150de-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.034338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.034199 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mjwf\" (UniqueName: \"kubernetes.io/projected/f2207f68-1e2a-4ace-a900-0c9ed27150de-kube-api-access-4mjwf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.034338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.034254 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2207f68-1e2a-4ace-a900-0c9ed27150de-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.034338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.034289 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2207f68-1e2a-4ace-a900-0c9ed27150de-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.034481 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.034419 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2207f68-1e2a-4ace-a900-0c9ed27150de-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.034481 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.034447 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2207f68-1e2a-4ace-a900-0c9ed27150de-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.135281 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.135242 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2207f68-1e2a-4ace-a900-0c9ed27150de-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.135440 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.135327 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2207f68-1e2a-4ace-a900-0c9ed27150de-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.135440 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.135398 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2207f68-1e2a-4ace-a900-0c9ed27150de-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.135440 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.135424 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2207f68-1e2a-4ace-a900-0c9ed27150de-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.135615 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.135462 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2207f68-1e2a-4ace-a900-0c9ed27150de-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.135615 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.135497 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mjwf\" (UniqueName: \"kubernetes.io/projected/f2207f68-1e2a-4ace-a900-0c9ed27150de-kube-api-access-4mjwf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.135723 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.135700 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2207f68-1e2a-4ace-a900-0c9ed27150de-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.135800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.135739 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2207f68-1e2a-4ace-a900-0c9ed27150de-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.135953 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.135930 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2207f68-1e2a-4ace-a900-0c9ed27150de-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.137684 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.137661 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2207f68-1e2a-4ace-a900-0c9ed27150de-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.137998 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.137982 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2207f68-1e2a-4ace-a900-0c9ed27150de-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.143023 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.143001 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mjwf\" (UniqueName: \"kubernetes.io/projected/f2207f68-1e2a-4ace-a900-0c9ed27150de-kube-api-access-4mjwf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zcm4t\" (UID: \"f2207f68-1e2a-4ace-a900-0c9ed27150de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.266940 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.266849 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:42.407449 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.407417 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t"] Jul 03 19:21:42.408239 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:21:42.407752 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2207f68_1e2a_4ace_a900_0c9ed27150de.slice/crio-252ed3c2c90a910ec88791aad2db4f9f70cf3336454055981a2cda7a86753c4b WatchSource:0}: Error finding container 252ed3c2c90a910ec88791aad2db4f9f70cf3336454055981a2cda7a86753c4b: Status 404 returned error can't find the container with id 252ed3c2c90a910ec88791aad2db4f9f70cf3336454055981a2cda7a86753c4b Jul 03 19:21:42.802706 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.802674 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" event={"ID":"f2207f68-1e2a-4ace-a900-0c9ed27150de","Type":"ContainerStarted","Data":"75a04122511d15625a39bb2bcbf85481c18abfa8017934791bae1f5beb4273d9"} Jul 03 19:21:42.802899 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.802722 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" event={"ID":"f2207f68-1e2a-4ace-a900-0c9ed27150de","Type":"ContainerStarted","Data":"252ed3c2c90a910ec88791aad2db4f9f70cf3336454055981a2cda7a86753c4b"} Jul 03 19:21:42.823444 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:42.823332 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" podStartSLOduration=1.662146662 podStartE2EDuration="1.823312492s" totalImagesPullingTime="161.16583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:21:42.821716787 +0000 UTC m=+682.969369058" watchObservedRunningTime="2026-07-03 19:21:42.823312492 +0000 UTC m=+682.970964750" Jul 03 19:21:43.969229 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:43.969195 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:43.969679 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:43.969344 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:43.982040 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:43.982018 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:44.823842 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:44.823813 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn" Jul 03 19:21:52.267893 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:52.267838 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:52.268469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:52.267923 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:52.282263 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:52.282230 2587 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:52.862157 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:52.862124 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zcm4t" Jul 03 19:21:56.970931 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:21:56.970895 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:22:06.372388 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:22:06.372361 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:22:12.177156 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:22:12.177054 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:22:41.365239 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:22:41.365192 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:23:47.520933 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:47.520837 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64bbdcc5-f2kkg"] Jul 03 19:23:47.521507 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:47.521064 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-64bbdcc5-f2kkg" podUID="b5c164cb-37da-49cd-a23d-f44cec936fd2" containerName="authorino" containerID="cri-o://17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635" gracePeriod=30 Jul 03 19:23:47.775456 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:47.775397 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64bbdcc5-f2kkg" Jul 03 19:23:47.854861 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:47.854828 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z4pl\" (UniqueName: \"kubernetes.io/projected/b5c164cb-37da-49cd-a23d-f44cec936fd2-kube-api-access-6z4pl\") pod \"b5c164cb-37da-49cd-a23d-f44cec936fd2\" (UID: \"b5c164cb-37da-49cd-a23d-f44cec936fd2\") " Jul 03 19:23:47.855055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:47.854886 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5c164cb-37da-49cd-a23d-f44cec936fd2-tls-cert\") pod \"b5c164cb-37da-49cd-a23d-f44cec936fd2\" (UID: \"b5c164cb-37da-49cd-a23d-f44cec936fd2\") " Jul 03 19:23:47.856976 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:47.856950 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5c164cb-37da-49cd-a23d-f44cec936fd2-kube-api-access-6z4pl" (OuterVolumeSpecName: "kube-api-access-6z4pl") pod "b5c164cb-37da-49cd-a23d-f44cec936fd2" (UID: "b5c164cb-37da-49cd-a23d-f44cec936fd2"). InnerVolumeSpecName "kube-api-access-6z4pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:23:47.865581 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:47.865556 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5c164cb-37da-49cd-a23d-f44cec936fd2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b5c164cb-37da-49cd-a23d-f44cec936fd2" (UID: "b5c164cb-37da-49cd-a23d-f44cec936fd2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:23:47.956354 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:47.956319 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z4pl\" (UniqueName: \"kubernetes.io/projected/b5c164cb-37da-49cd-a23d-f44cec936fd2-kube-api-access-6z4pl\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:23:47.956354 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:47.956354 2587 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5c164cb-37da-49cd-a23d-f44cec936fd2-tls-cert\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:23:48.000730 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:48.000653 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:23:48.099018 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:48.098981 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:23:48.443205 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:48.443118 2587 generic.go:356] "Generic (PLEG): container finished" podID="b5c164cb-37da-49cd-a23d-f44cec936fd2" containerID="17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635" exitCode=0 Jul 03 19:23:48.443205 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:48.443158 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64bbdcc5-f2kkg" Jul 03 19:23:48.443431 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:48.443198 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64bbdcc5-f2kkg" event={"ID":"b5c164cb-37da-49cd-a23d-f44cec936fd2","Type":"ContainerDied","Data":"17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635"} Jul 03 19:23:48.443431 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:48.443239 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64bbdcc5-f2kkg" event={"ID":"b5c164cb-37da-49cd-a23d-f44cec936fd2","Type":"ContainerDied","Data":"3c8234ec8dce67ff99d0fb748d59da89dc476ba0f552a94c73dfdcb9b99093f7"} Jul 03 19:23:48.443431 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:48.443260 2587 scope.go:117] "RemoveContainer" containerID="17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635" Jul 03 19:23:48.452604 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:48.452591 2587 scope.go:117] "RemoveContainer" containerID="17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635" Jul 03 19:23:48.452873 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:23:48.452855 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635\": container with ID starting with 17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635 not found: ID does not exist" containerID="17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635" Jul 03 19:23:48.452927 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:48.452884 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635"} err="failed to get container status \"17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635\": rpc error: code = NotFound desc = could not find container \"17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635\": container with ID starting with 17cc6e0cb914fff9d3e224a6503365587f507cf4962738dd30d89a684c621635 not found: ID does not exist" Jul 03 19:23:48.462095 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:48.462074 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64bbdcc5-f2kkg"] Jul 03 19:23:48.464871 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:48.464852 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64bbdcc5-f2kkg"] Jul 03 19:23:49.092932 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:49.092884 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:23:49.192144 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:49.192113 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:23:49.446453 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:23:49.446379 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5c164cb-37da-49cd-a23d-f44cec936fd2" path="/var/lib/kubelet/pods/b5c164cb-37da-49cd-a23d-f44cec936fd2/volumes" Jul 03 19:24:19.752930 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:24:19.752896 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:24:28.835568 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:24:28.835531 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:24:28.937274 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:24:28.937242 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:25:10.984142 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:25:10.984109 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:25:11.085381 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:25:11.085351 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:26:46.904255 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:46.904171 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:26:48.143392 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:48.143351 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:26:48.828255 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:48.828220 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:26:58.540619 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:58.540583 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:26:58.647631 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:58.647587 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8689fb654f-65mz9"] Jul 03 19:26:58.647940 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:58.647885 2587 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-8689fb654f-65mz9" podUID="a7982782-1f2f-4ac3-b538-fd09f9b12335" containerName="manager" containerID="cri-o://e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183" gracePeriod=30 Jul 03 19:26:58.919931 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:58.919907 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8689fb654f-65mz9" Jul 03 19:26:58.994657 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:58.994626 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cm2t\" (UniqueName: \"kubernetes.io/projected/a7982782-1f2f-4ac3-b538-fd09f9b12335-kube-api-access-4cm2t\") pod \"a7982782-1f2f-4ac3-b538-fd09f9b12335\" (UID: \"a7982782-1f2f-4ac3-b538-fd09f9b12335\") " Jul 03 19:26:58.994839 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:58.994722 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7982782-1f2f-4ac3-b538-fd09f9b12335-webhook-cert\") pod \"a7982782-1f2f-4ac3-b538-fd09f9b12335\" (UID: \"a7982782-1f2f-4ac3-b538-fd09f9b12335\") " Jul 03 19:26:58.996608 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:58.996573 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7982782-1f2f-4ac3-b538-fd09f9b12335-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a7982782-1f2f-4ac3-b538-fd09f9b12335" (UID: "a7982782-1f2f-4ac3-b538-fd09f9b12335"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 19:26:58.996712 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:58.996627 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7982782-1f2f-4ac3-b538-fd09f9b12335-kube-api-access-4cm2t" (OuterVolumeSpecName: "kube-api-access-4cm2t") pod "a7982782-1f2f-4ac3-b538-fd09f9b12335" (UID: "a7982782-1f2f-4ac3-b538-fd09f9b12335"). InnerVolumeSpecName "kube-api-access-4cm2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:26:59.096659 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:59.096568 2587 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a7982782-1f2f-4ac3-b538-fd09f9b12335-webhook-cert\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:26:59.096901 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:59.096882 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cm2t\" (UniqueName: \"kubernetes.io/projected/a7982782-1f2f-4ac3-b538-fd09f9b12335-kube-api-access-4cm2t\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:26:59.380521 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:59.380425 2587 generic.go:356] "Generic (PLEG): container finished" podID="a7982782-1f2f-4ac3-b538-fd09f9b12335" containerID="e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183" exitCode=0 Jul 03 19:26:59.380521 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:59.380483 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8689fb654f-65mz9" Jul 03 19:26:59.380521 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:59.380508 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8689fb654f-65mz9" event={"ID":"a7982782-1f2f-4ac3-b538-fd09f9b12335","Type":"ContainerDied","Data":"e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183"} Jul 03 19:26:59.380794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:59.380583 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8689fb654f-65mz9" event={"ID":"a7982782-1f2f-4ac3-b538-fd09f9b12335","Type":"ContainerDied","Data":"980fecbcef32d6e9d1ef70c8725a127ed06396c9e8873e3964630197eac1395c"} Jul 03 19:26:59.380794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:59.380605 2587 scope.go:117] "RemoveContainer" containerID="e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183" Jul 03 19:26:59.390319 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:59.390302 2587 scope.go:117] "RemoveContainer" containerID="e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183" Jul 03 19:26:59.390588 ip-10-0-130-57 kubenswrapper[2587]: E0703 19:26:59.390565 2587 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183\": container with ID starting with e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183 not found: ID does not exist" containerID="e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183" Jul 03 19:26:59.390669 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:59.390596 2587 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183"} err="failed to get container status \"e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183\": rpc error: code = NotFound desc = could not find container \"e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183\": container with ID starting with e9da1c927585dfb5721a4a51c823b77cea8339a00440584ccd5548cceea91183 not found: ID does not exist" Jul 03 19:26:59.401055 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:59.401029 2587 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8689fb654f-65mz9"] Jul 03 19:26:59.402807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:59.402788 2587 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8689fb654f-65mz9"] Jul 03 19:26:59.447409 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:26:59.447387 2587 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7982782-1f2f-4ac3-b538-fd09f9b12335" path="/var/lib/kubelet/pods/a7982782-1f2f-4ac3-b538-fd09f9b12335/volumes" Jul 03 19:27:00.079136 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.079099 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:27:00.154818 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.154784 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8689fb654f-fh9c6"] Jul 03 19:27:00.155187 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.155176 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7982782-1f2f-4ac3-b538-fd09f9b12335" containerName="manager" Jul 03 19:27:00.155231 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.155189 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7982782-1f2f-4ac3-b538-fd09f9b12335" containerName="manager" Jul 03 19:27:00.155231 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.155205 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c164cb-37da-49cd-a23d-f44cec936fd2" containerName="authorino" Jul 03 19:27:00.155231 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.155211 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c164cb-37da-49cd-a23d-f44cec936fd2" containerName="authorino" Jul 03 19:27:00.155327 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.155274 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7982782-1f2f-4ac3-b538-fd09f9b12335" containerName="manager" Jul 03 19:27:00.155327 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.155286 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5c164cb-37da-49cd-a23d-f44cec936fd2" containerName="authorino" Jul 03 19:27:00.159717 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.159686 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8689fb654f-fh9c6" Jul 03 19:27:00.162601 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.162582 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 03 19:27:00.162719 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.162584 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7rdmp\"" Jul 03 19:27:00.162719 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.162664 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 03 19:27:00.168333 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.168312 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8689fb654f-fh9c6"] Jul 03 19:27:00.207386 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.207355 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e143bcba-0998-401a-88ca-9c108ba65fd0-webhook-cert\") pod \"maas-controller-8689fb654f-fh9c6\" (UID: \"e143bcba-0998-401a-88ca-9c108ba65fd0\") " pod="opendatahub/maas-controller-8689fb654f-fh9c6" Jul 03 19:27:00.207531 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.207446 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnbpg\" (UniqueName: \"kubernetes.io/projected/e143bcba-0998-401a-88ca-9c108ba65fd0-kube-api-access-nnbpg\") pod \"maas-controller-8689fb654f-fh9c6\" (UID: \"e143bcba-0998-401a-88ca-9c108ba65fd0\") " pod="opendatahub/maas-controller-8689fb654f-fh9c6" Jul 03 19:27:00.308878 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.308841 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e143bcba-0998-401a-88ca-9c108ba65fd0-webhook-cert\") pod \"maas-controller-8689fb654f-fh9c6\" (UID: \"e143bcba-0998-401a-88ca-9c108ba65fd0\") " pod="opendatahub/maas-controller-8689fb654f-fh9c6" Jul 03 19:27:00.309071 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.308944 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnbpg\" (UniqueName: \"kubernetes.io/projected/e143bcba-0998-401a-88ca-9c108ba65fd0-kube-api-access-nnbpg\") pod \"maas-controller-8689fb654f-fh9c6\" (UID: \"e143bcba-0998-401a-88ca-9c108ba65fd0\") " pod="opendatahub/maas-controller-8689fb654f-fh9c6" Jul 03 19:27:00.311355 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.311329 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e143bcba-0998-401a-88ca-9c108ba65fd0-webhook-cert\") pod \"maas-controller-8689fb654f-fh9c6\" (UID: \"e143bcba-0998-401a-88ca-9c108ba65fd0\") " pod="opendatahub/maas-controller-8689fb654f-fh9c6" Jul 03 19:27:00.317271 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.317251 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnbpg\" (UniqueName: \"kubernetes.io/projected/e143bcba-0998-401a-88ca-9c108ba65fd0-kube-api-access-nnbpg\") pod \"maas-controller-8689fb654f-fh9c6\" (UID: \"e143bcba-0998-401a-88ca-9c108ba65fd0\") " pod="opendatahub/maas-controller-8689fb654f-fh9c6" Jul 03 19:27:00.471678 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.471594 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8689fb654f-fh9c6" Jul 03 19:27:00.605240 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.605172 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8689fb654f-fh9c6"] Jul 03 19:27:00.607581 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:27:00.607554 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode143bcba_0998_401a_88ca_9c108ba65fd0.slice/crio-f26deb75dcc44ff4ceb09291c6b940755b53e6df34542a10369175520d3e8303 WatchSource:0}: Error finding container f26deb75dcc44ff4ceb09291c6b940755b53e6df34542a10369175520d3e8303: Status 404 returned error can't find the container with id f26deb75dcc44ff4ceb09291c6b940755b53e6df34542a10369175520d3e8303 Jul 03 19:27:00.609043 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:00.609026 2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 19:27:01.393538 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:01.393504 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8689fb654f-fh9c6" event={"ID":"e143bcba-0998-401a-88ca-9c108ba65fd0","Type":"ContainerStarted","Data":"700bc44692dd69fe5e770c4f6ecf0d501458eea944fc738e4cb8239e80a1a790"} Jul 03 19:27:01.393946 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:01.393554 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8689fb654f-fh9c6" event={"ID":"e143bcba-0998-401a-88ca-9c108ba65fd0","Type":"ContainerStarted","Data":"f26deb75dcc44ff4ceb09291c6b940755b53e6df34542a10369175520d3e8303"} Jul 03 19:27:01.393946 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:01.393644 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8689fb654f-fh9c6" Jul 03 19:27:01.408814 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:01.408730 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8689fb654f-fh9c6" podStartSLOduration=0.989340736 podStartE2EDuration="1.408711621s" totalImagesPullingTime="419.370885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:27:01.407948843 +0000 UTC m=+1001.555601100" watchObservedRunningTime="2026-07-03 19:27:01.408711621 +0000 UTC m=+1001.556363880" Jul 03 19:27:12.404204 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:12.404172 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8689fb654f-fh9c6" Jul 03 19:27:15.593367 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:15.593334 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:27:15.639417 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:15.639372 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:27:35.453876 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:27:35.453837 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:29:37.063186 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:29:37.063155 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:29:37.145965 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:29:37.145930 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:29:37.250955 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:29:37.250918 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:29:42.791104 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:29:42.791014 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:29:42.896938 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:29:42.896908 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:29:42.991462 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:29:42.991430 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:29:43.140337 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:29:43.140302 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:29:48.762221 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:29:48.762187 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:29:48.824025 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:29:48.823983 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:30:00.141034 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:00.140997 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29718450-8kkm2"] Jul 03 19:30:00.144489 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:00.144474 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718450-8kkm2" Jul 03 19:30:00.160385 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:00.160360 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29718450-8kkm2"] Jul 03 19:30:00.272318 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:00.272280 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jkww\" (UniqueName: \"kubernetes.io/projected/e7526158-7e67-4bbf-a484-8a27ad89c155-kube-api-access-6jkww\") pod \"maas-api-key-cleanup-29718450-8kkm2\" (UID: \"e7526158-7e67-4bbf-a484-8a27ad89c155\") " pod="opendatahub/maas-api-key-cleanup-29718450-8kkm2" Jul 03 19:30:00.373636 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:00.373590 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jkww\" (UniqueName: \"kubernetes.io/projected/e7526158-7e67-4bbf-a484-8a27ad89c155-kube-api-access-6jkww\") pod \"maas-api-key-cleanup-29718450-8kkm2\" (UID: \"e7526158-7e67-4bbf-a484-8a27ad89c155\") " pod="opendatahub/maas-api-key-cleanup-29718450-8kkm2" Jul 03 19:30:00.381453 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:00.381428 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jkww\" (UniqueName: \"kubernetes.io/projected/e7526158-7e67-4bbf-a484-8a27ad89c155-kube-api-access-6jkww\") pod \"maas-api-key-cleanup-29718450-8kkm2\" (UID: \"e7526158-7e67-4bbf-a484-8a27ad89c155\") " pod="opendatahub/maas-api-key-cleanup-29718450-8kkm2" Jul 03 19:30:00.454497 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:00.454413 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718450-8kkm2" Jul 03 19:30:00.794311 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:00.794287 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29718450-8kkm2"] Jul 03 19:30:00.796299 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:30:00.796269 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7526158_7e67_4bbf_a484_8a27ad89c155.slice/crio-30075218be8fd83784bd9dd6ae37f67d83fe4b65feb8c9c9a2787860daf5ce63 WatchSource:0}: Error finding container 30075218be8fd83784bd9dd6ae37f67d83fe4b65feb8c9c9a2787860daf5ce63: Status 404 returned error can't find the container with id 30075218be8fd83784bd9dd6ae37f67d83fe4b65feb8c9c9a2787860daf5ce63 Jul 03 19:30:01.317430 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:01.317395 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718450-8kkm2" event={"ID":"e7526158-7e67-4bbf-a484-8a27ad89c155","Type":"ContainerStarted","Data":"30075218be8fd83784bd9dd6ae37f67d83fe4b65feb8c9c9a2787860daf5ce63"} Jul 03 19:30:04.336115 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:04.336080 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718450-8kkm2" event={"ID":"e7526158-7e67-4bbf-a484-8a27ad89c155","Type":"ContainerStarted","Data":"d6b85f6bd5e1a3ed8114d14f8193c2d9e7fe1567dbbf421bbbfb56ac436a5171"} Jul 03 19:30:04.352009 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:04.351959 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29718450-8kkm2" podStartSLOduration=1.652615118 podStartE2EDuration="4.351945402s" totalImagesPullingTime="2.699330284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:30:04.350176765 +0000 UTC m=+1184.497829045" watchObservedRunningTime="2026-07-03 19:30:04.351945402 +0000 UTC m=+1184.499597657" Jul 03 19:30:05.342520 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:05.342482 2587 generic.go:356] "Generic (PLEG): container finished" podID="e7526158-7e67-4bbf-a484-8a27ad89c155" containerID="d6b85f6bd5e1a3ed8114d14f8193c2d9e7fe1567dbbf421bbbfb56ac436a5171" exitCode=0 Jul 03 19:30:05.342929 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:05.342576 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718450-8kkm2" event={"ID":"e7526158-7e67-4bbf-a484-8a27ad89c155","Type":"ContainerDied","Data":"d6b85f6bd5e1a3ed8114d14f8193c2d9e7fe1567dbbf421bbbfb56ac436a5171"} Jul 03 19:30:06.495405 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:06.495378 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718450-8kkm2" Jul 03 19:30:06.634040 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:06.633952 2587 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jkww\" (UniqueName: \"kubernetes.io/projected/e7526158-7e67-4bbf-a484-8a27ad89c155-kube-api-access-6jkww\") pod \"e7526158-7e67-4bbf-a484-8a27ad89c155\" (UID: \"e7526158-7e67-4bbf-a484-8a27ad89c155\") " Jul 03 19:30:06.636054 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:06.636020 2587 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7526158-7e67-4bbf-a484-8a27ad89c155-kube-api-access-6jkww" (OuterVolumeSpecName: "kube-api-access-6jkww") pod "e7526158-7e67-4bbf-a484-8a27ad89c155" (UID: "e7526158-7e67-4bbf-a484-8a27ad89c155"). InnerVolumeSpecName "kube-api-access-6jkww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 19:30:06.735835 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:06.735753 2587 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jkww\" (UniqueName: \"kubernetes.io/projected/e7526158-7e67-4bbf-a484-8a27ad89c155-kube-api-access-6jkww\") on node \"ip-10-0-130-57.ec2.internal\" DevicePath \"\"" Jul 03 19:30:07.353308 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:07.353279 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718450-8kkm2" event={"ID":"e7526158-7e67-4bbf-a484-8a27ad89c155","Type":"ContainerDied","Data":"30075218be8fd83784bd9dd6ae37f67d83fe4b65feb8c9c9a2787860daf5ce63"} Jul 03 19:30:07.353308 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:07.353304 2587 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718450-8kkm2" Jul 03 19:30:07.353558 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:07.353361 2587 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30075218be8fd83784bd9dd6ae37f67d83fe4b65feb8c9c9a2787860daf5ce63" Jul 03 19:30:55.777949 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:30:55.777908 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:31:28.160432 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:31:28.160334 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:35:16.511130 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:16.511092 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:35:22.016215 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:22.016182 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b8cb6fc6-nvnpv_90270640-b967-47cf-b825-d611623ee17b/maas-api/0.log" Jul 03 19:35:22.122509 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:22.122473 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29718450-8kkm2_e7526158-7e67-4bbf-a484-8a27ad89c155/cleanup/0.log" Jul 03 19:35:22.245097 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:22.245065 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8689fb654f-fh9c6_e143bcba-0998-401a-88ca-9c108ba65fd0/manager/0.log" Jul 03 19:35:22.363563 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:22.363537 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vdbk2_e372f4e3-daa8-4c52-b641-44831273f48f/server/0.log" Jul 03 19:35:22.484210 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:22.484174 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-d4vbc_8f6068d3-d38e-4af8-bc7b-86bb44554ce6/manager/0.log" Jul 03 19:35:22.841022 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:22.840998 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5db468f498-sqhmx_c0fa91f8-3f13-4588-b51e-7a83d897260b/copy-manifests/0.log" Jul 03 19:35:22.863482 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:22.863454 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5db468f498-sqhmx_c0fa91f8-3f13-4588-b51e-7a83d897260b/manager/0.log" Jul 03 19:35:22.975027 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:22.974994 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-4tgnm_2327bef8-3886-4e6a-9f56-cc95a2adf6f6/postgres/0.log" Jul 03 19:35:24.350872 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:24.350838 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rr88j_ff3659d0-8c50-47ab-a520-e6c87c8b0c56/manager/0.log" Jul 03 19:35:24.687638 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:24.687552 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-khq2k_5a0d69d3-3167-44f2-8885-88f06130d225/registry-server/0.log" Jul 03 19:35:25.518729 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:25.518690 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-k6z8q_456b8ec8-eaf3-44ed-9cc6-5af3740ac744/discovery/0.log" Jul 03 19:35:25.629853 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:25.629820 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-994f4989b-9hntc_9a829d83-4443-450c-87cc-f7f1ce2d6771/kube-auth-proxy/0.log" Jul 03 19:35:25.859705 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:25.859671 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dmpcv_b11c9607-14c8-4605-b083-2c4aaf8e2bf6/istio-proxy/1.log" Jul 03 19:35:25.976606 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:25.976573 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-59h6g_78603a7e-d538-477d-8179-c8121425c885/payload-pre-processing/0.log" Jul 03 19:35:26.105624 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:26.105595 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qvr8m_7bd85cf4-10bf-4159-b4cd-1e35de3fe692/payload-processing/0.log" Jul 03 19:35:26.553954 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:26.553919 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hcrpn_0bb5ff8a-9f0c-48f9-976d-4a8f5a1485b0/main/0.log" Jul 03 19:35:26.663730 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:26.663695 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-zcm4t_f2207f68-1e2a-4ace-a900-0c9ed27150de/main/0.log" Jul 03 19:35:31.516323 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.516290 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c9kmg/must-gather-8lgkc"] Jul 03 19:35:31.516844 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.516825 2587 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7526158-7e67-4bbf-a484-8a27ad89c155" containerName="cleanup" Jul 03 19:35:31.516927 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.516847 2587 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7526158-7e67-4bbf-a484-8a27ad89c155" containerName="cleanup" Jul 03 19:35:31.516994 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.516958 2587 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7526158-7e67-4bbf-a484-8a27ad89c155" containerName="cleanup" Jul 03 19:35:31.520592 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.520570 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9kmg/must-gather-8lgkc" Jul 03 19:35:31.522969 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.522944 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9kmg\"/\"openshift-service-ca.crt\"" Jul 03 19:35:31.523112 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.522982 2587 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9kmg\"/\"kube-root-ca.crt\"" Jul 03 19:35:31.523112 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.522982 2587 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c9kmg\"/\"default-dockercfg-gjmpz\"" Jul 03 19:35:31.538718 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.538685 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9kmg/must-gather-8lgkc"] Jul 03 19:35:31.672465 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.672418 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvcrv\" (UniqueName: \"kubernetes.io/projected/c8f6ba29-4196-4776-b403-cd91c65ca1f2-kube-api-access-nvcrv\") pod \"must-gather-8lgkc\" (UID: \"c8f6ba29-4196-4776-b403-cd91c65ca1f2\") " pod="openshift-must-gather-c9kmg/must-gather-8lgkc" Jul 03 19:35:31.672662 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.672547 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c8f6ba29-4196-4776-b403-cd91c65ca1f2-must-gather-output\") pod \"must-gather-8lgkc\" (UID: \"c8f6ba29-4196-4776-b403-cd91c65ca1f2\") " pod="openshift-must-gather-c9kmg/must-gather-8lgkc" Jul 03 19:35:31.774073 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.773969 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c8f6ba29-4196-4776-b403-cd91c65ca1f2-must-gather-output\") pod \"must-gather-8lgkc\" (UID: \"c8f6ba29-4196-4776-b403-cd91c65ca1f2\") " pod="openshift-must-gather-c9kmg/must-gather-8lgkc" Jul 03 19:35:31.774073 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.774067 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvcrv\" (UniqueName: \"kubernetes.io/projected/c8f6ba29-4196-4776-b403-cd91c65ca1f2-kube-api-access-nvcrv\") pod \"must-gather-8lgkc\" (UID: \"c8f6ba29-4196-4776-b403-cd91c65ca1f2\") " pod="openshift-must-gather-c9kmg/must-gather-8lgkc" Jul 03 19:35:31.774331 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.774310 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c8f6ba29-4196-4776-b403-cd91c65ca1f2-must-gather-output\") pod \"must-gather-8lgkc\" (UID: \"c8f6ba29-4196-4776-b403-cd91c65ca1f2\") " pod="openshift-must-gather-c9kmg/must-gather-8lgkc" Jul 03 19:35:31.783449 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.783420 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvcrv\" (UniqueName: \"kubernetes.io/projected/c8f6ba29-4196-4776-b403-cd91c65ca1f2-kube-api-access-nvcrv\") pod \"must-gather-8lgkc\" (UID: \"c8f6ba29-4196-4776-b403-cd91c65ca1f2\") " pod="openshift-must-gather-c9kmg/must-gather-8lgkc" Jul 03 19:35:31.829750 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.829712 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9kmg/must-gather-8lgkc" Jul 03 19:35:31.974005 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.973937 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9kmg/must-gather-8lgkc"] Jul 03 19:35:31.976613 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:35:31.976584 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8f6ba29_4196_4776_b403_cd91c65ca1f2.slice/crio-6ec3b063092bb8b83452a020ec22839e4fcd729e7f0ea24ae28e83ee42f11087 WatchSource:0}: Error finding container 6ec3b063092bb8b83452a020ec22839e4fcd729e7f0ea24ae28e83ee42f11087: Status 404 returned error can't find the container with id 6ec3b063092bb8b83452a020ec22839e4fcd729e7f0ea24ae28e83ee42f11087 Jul 03 19:35:31.978403 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.978386 2587 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 19:35:31.993766 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:31.993730 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9kmg/must-gather-8lgkc" event={"ID":"c8f6ba29-4196-4776-b403-cd91c65ca1f2","Type":"ContainerStarted","Data":"6ec3b063092bb8b83452a020ec22839e4fcd729e7f0ea24ae28e83ee42f11087"} Jul 03 19:35:32.281994 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:32.281955 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:35:32.395172 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:32.395135 2587 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" limit=1024 Jul 03 19:35:33.000973 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:33.000906 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9kmg/must-gather-8lgkc" event={"ID":"c8f6ba29-4196-4776-b403-cd91c65ca1f2","Type":"ContainerStarted","Data":"dfb6a8481a6f25abcc7473e05a3c698b5f84e598ef629be5ffbba651954297f0"} Jul 03 19:35:34.011234 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:34.011198 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9kmg/must-gather-8lgkc" event={"ID":"c8f6ba29-4196-4776-b403-cd91c65ca1f2","Type":"ContainerStarted","Data":"e20515837fa7e4ee2724dccd0ca31bb5005eb072a5b250f3590e6ec3e5d18e41"} Jul 03 19:35:34.026301 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:34.026242 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c9kmg/must-gather-8lgkc" podStartSLOduration=2.182761085 podStartE2EDuration="3.026224072s" totalImagesPullingTime="843.462987ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 19:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:35:34.025247105 +0000 UTC m=+1514.172899364" watchObservedRunningTime="2026-07-03 19:35:34.026224072 +0000 UTC m=+1514.173876333" Jul 03 19:35:34.414698 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:34.414659 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lh4kg_e8d28707-c79a-489a-aef0-b389707b64c1/global-pull-secret-syncer/0.log" Jul 03 19:35:34.504760 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:34.504720 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cjbmx_8671be47-a9a5-4fd4-b103-a00d3c53b2ff/konnectivity-agent/0.log" Jul 03 19:35:34.579833 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:34.579805 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-57.ec2.internal_85fde282788a9bf74b4b07459943d969/haproxy/0.log" Jul 03 19:35:39.781407 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:39.781365 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-rr88j_ff3659d0-8c50-47ab-a520-e6c87c8b0c56/manager/0.log" Jul 03 19:35:39.871755 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:39.871714 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-khq2k_5a0d69d3-3167-44f2-8885-88f06130d225/registry-server/0.log" Jul 03 19:35:41.685204 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:41.685171 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cef902af-cfec-46a6-a379-d5fef96cd063/alertmanager/0.log" Jul 03 19:35:41.707832 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:41.707795 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cef902af-cfec-46a6-a379-d5fef96cd063/config-reloader/0.log" Jul 03 19:35:41.727262 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:41.727222 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cef902af-cfec-46a6-a379-d5fef96cd063/kube-rbac-proxy-web/0.log" Jul 03 19:35:41.757987 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:41.757956 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cef902af-cfec-46a6-a379-d5fef96cd063/kube-rbac-proxy/0.log" Jul 03 19:35:41.789807 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:41.789555 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cef902af-cfec-46a6-a379-d5fef96cd063/kube-rbac-proxy-metric/0.log" Jul 03 19:35:41.813797 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:41.811655 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cef902af-cfec-46a6-a379-d5fef96cd063/prom-label-proxy/0.log" Jul 03 19:35:41.837289 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:41.837256 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cef902af-cfec-46a6-a379-d5fef96cd063/init-config-reloader/0.log" Jul 03 19:35:41.888061 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:41.888026 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-pj7ns_0c792b24-59a4-4c99-b77b-c3709eba2bea/cluster-monitoring-operator/0.log" Jul 03 19:35:41.922424 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:41.922394 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-x4st8_857dd60a-05ec-4a42-a546-9e210c61a80e/kube-state-metrics/0.log" Jul 03 19:35:41.949107 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:41.949072 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-x4st8_857dd60a-05ec-4a42-a546-9e210c61a80e/kube-rbac-proxy-main/0.log" Jul 03 19:35:41.981321 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:41.980914 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-x4st8_857dd60a-05ec-4a42-a546-9e210c61a80e/kube-rbac-proxy-self/0.log" Jul 03 19:35:42.230192 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:42.230114 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pkql9_08faacaf-14ab-4422-b2fd-62caa9c0f33e/node-exporter/0.log" Jul 03 19:35:42.252606 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:42.252571 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pkql9_08faacaf-14ab-4422-b2fd-62caa9c0f33e/kube-rbac-proxy/0.log" Jul 03 19:35:42.274580 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:42.274546 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pkql9_08faacaf-14ab-4422-b2fd-62caa9c0f33e/init-textfile/0.log" Jul 03 19:35:42.314193 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:42.314161 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-r8zsq_67860888-f04c-418a-82e6-c65f7fc571e7/kube-rbac-proxy-main/0.log" Jul 03 19:35:42.341162 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:42.341130 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-r8zsq_67860888-f04c-418a-82e6-c65f7fc571e7/kube-rbac-proxy-self/0.log" Jul 03 19:35:42.358480 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:42.358400 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-r8zsq_67860888-f04c-418a-82e6-c65f7fc571e7/openshift-state-metrics/0.log" Jul 03 19:35:42.642246 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:42.642215 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6969b899b-6d42h_d7326ca1-e9af-437b-a585-5d40f99dbdf9/telemeter-client/0.log" Jul 03 19:35:42.664677 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:42.664643 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6969b899b-6d42h_d7326ca1-e9af-437b-a585-5d40f99dbdf9/reload/0.log" Jul 03 19:35:42.685867 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:42.685834 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6969b899b-6d42h_d7326ca1-e9af-437b-a585-5d40f99dbdf9/kube-rbac-proxy/0.log" Jul 03 19:35:45.090340 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.090282 2587 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr"] Jul 03 19:35:45.097637 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.097608 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.109254 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.109224 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr"] Jul 03 19:35:45.134408 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.134366 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-sys\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.134668 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.134648 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-proc\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.134838 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.134821 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-podres\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.135059 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.135044 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-lib-modules\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.135164 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.135151 2587 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k85dk\" (UniqueName: \"kubernetes.io/projected/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-kube-api-access-k85dk\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.236799 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.236726 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-lib-modules\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.237014 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.236829 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k85dk\" (UniqueName: \"kubernetes.io/projected/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-kube-api-access-k85dk\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.237014 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.236946 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-sys\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.237014 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.236981 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-proc\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.237014 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.237004 2587 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-podres\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.237269 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.237248 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-podres\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.237375 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.237357 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-lib-modules\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.237793 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.237754 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-sys\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.237913 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.237835 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-proc\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.245798 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.245713 2587 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k85dk\" (UniqueName: \"kubernetes.io/projected/11c6f1d8-4e8d-4d10-a7e8-5c40131747ee-kube-api-access-k85dk\") pod \"perf-node-gather-daemonset-kf4pr\" (UID: \"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee\") " pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.280101 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.280066 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8554d56975-vrvqw_0782921c-e723-4e06-b586-661de50d940f/console/0.log" Jul 03 19:35:45.319360 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.319326 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-bnnvk_6e093c33-3873-43c2-a004-41e8569b2f71/download-server/0.log" Jul 03 19:35:45.420288 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.420192 2587 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:45.619820 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:45.619764 2587 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr"] Jul 03 19:35:45.623445 ip-10-0-130-57 kubenswrapper[2587]: W0703 19:35:45.623409 2587 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod11c6f1d8_4e8d_4d10_a7e8_5c40131747ee.slice/crio-05aad5dd703ff10d15b625045f98b92ccf0b2d83ca5df93c5f3378f71d9ff24b WatchSource:0}: Error finding container 05aad5dd703ff10d15b625045f98b92ccf0b2d83ca5df93c5f3378f71d9ff24b: Status 404 returned error can't find the container with id 05aad5dd703ff10d15b625045f98b92ccf0b2d83ca5df93c5f3378f71d9ff24b Jul 03 19:35:46.110356 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:46.110312 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" event={"ID":"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee","Type":"ContainerStarted","Data":"0bcf2bbb5c5ecf2eeeedc20433f9030db7dacada3c20ad055bc1b9a3f974956f"} Jul 03 19:35:46.110903 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:46.110383 2587 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" event={"ID":"11c6f1d8-4e8d-4d10-a7e8-5c40131747ee","Type":"ContainerStarted","Data":"05aad5dd703ff10d15b625045f98b92ccf0b2d83ca5df93c5f3378f71d9ff24b"} Jul 03 19:35:46.110903 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:46.110415 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:47.063380 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:47.063345 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m826r_75adf88a-862f-446c-82a5-8bbd5992149d/dns/0.log" Jul 03 19:35:47.082361 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:47.082328 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m826r_75adf88a-862f-446c-82a5-8bbd5992149d/kube-rbac-proxy/0.log" Jul 03 19:35:47.146800 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:47.146760 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-snbdp_eb073b99-db12-43df-b79c-f1ae057356cf/dns-node-resolver/0.log" Jul 03 19:35:47.689313 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:47.689279 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5f74775789-msxqv_48be8335-ed20-45ae-957d-e97347c724a2/registry/0.log" Jul 03 19:35:47.734299 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:47.734267 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hdp8t_dbb9f0b3-b16c-43e8-84a9-2d79872585fa/node-ca/0.log" Jul 03 19:35:48.705755 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:48.705715 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-k6z8q_456b8ec8-eaf3-44ed-9cc6-5af3740ac744/discovery/0.log" Jul 03 19:35:48.725855 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:48.725753 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-994f4989b-9hntc_9a829d83-4443-450c-87cc-f7f1ce2d6771/kube-auth-proxy/0.log" Jul 03 19:35:48.781732 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:48.781694 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dmpcv_b11c9607-14c8-4605-b083-2c4aaf8e2bf6/istio-proxy/0.log" Jul 03 19:35:48.812987 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:48.812955 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dmpcv_b11c9607-14c8-4605-b083-2c4aaf8e2bf6/istio-proxy/1.log" Jul 03 19:35:48.843338 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:48.843301 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-59h6g_78603a7e-d538-477d-8179-c8121425c885/payload-pre-processing/0.log" Jul 03 19:35:48.892385 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:48.892349 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qvr8m_7bd85cf4-10bf-4159-b4cd-1e35de3fe692/payload-processing/0.log" Jul 03 19:35:49.514658 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:49.514628 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bgdfp_96797db3-4d01-49be-9671-7e2d755f70db/serve-healthcheck-canary/0.log" Jul 03 19:35:50.046576 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:50.046550 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gq4v_79fccd49-ac9b-4b7d-be42-f7c7b7a69e08/kube-rbac-proxy/0.log" Jul 03 19:35:50.066147 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:50.066108 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gq4v_79fccd49-ac9b-4b7d-be42-f7c7b7a69e08/exporter/0.log" Jul 03 19:35:50.085952 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:50.085918 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6gq4v_79fccd49-ac9b-4b7d-be42-f7c7b7a69e08/extractor/0.log" Jul 03 19:35:52.131469 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:52.130412 2587 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" Jul 03 19:35:52.148367 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:52.148311 2587 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c9kmg/perf-node-gather-daemonset-kf4pr" podStartSLOduration=7.148294078 podStartE2EDuration="7.148294078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 19:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 19:35:46.125358944 +0000 UTC m=+1526.273011200" watchObservedRunningTime="2026-07-03 19:35:52.148294078 +0000 UTC m=+1532.295946336" Jul 03 19:35:52.342118 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:52.342062 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b8cb6fc6-nvnpv_90270640-b967-47cf-b825-d611623ee17b/maas-api/0.log" Jul 03 19:35:52.361231 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:52.361200 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29718450-8kkm2_e7526158-7e67-4bbf-a484-8a27ad89c155/cleanup/0.log" Jul 03 19:35:52.413860 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:52.413731 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8689fb654f-fh9c6_e143bcba-0998-401a-88ca-9c108ba65fd0/manager/0.log" Jul 03 19:35:52.431568 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:52.431544 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vdbk2_e372f4e3-daa8-4c52-b641-44831273f48f/server/0.log" Jul 03 19:35:52.517978 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:52.517938 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-d4vbc_8f6068d3-d38e-4af8-bc7b-86bb44554ce6/manager/0.log" Jul 03 19:35:52.715070 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:52.714954 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5db468f498-sqhmx_c0fa91f8-3f13-4588-b51e-7a83d897260b/manager/0.log" Jul 03 19:35:52.730249 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:52.730224 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5db468f498-sqhmx_c0fa91f8-3f13-4588-b51e-7a83d897260b/copy-manifests/0.log" Jul 03 19:35:52.752953 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:52.752922 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-4tgnm_2327bef8-3886-4e6a-9f56-cc95a2adf6f6/postgres/0.log" Jul 03 19:35:54.088844 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:54.088723 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xsthc_dcbfb72a-0620-4301-ba23-e06c9aa4e254/openshift-lws-operator/0.log" Jul 03 19:35:55.725823 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:55.725748 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-k6z8q_456b8ec8-eaf3-44ed-9cc6-5af3740ac744/discovery/0.log" Jul 03 19:35:55.737175 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:55.737143 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-994f4989b-9hntc_9a829d83-4443-450c-87cc-f7f1ce2d6771/kube-auth-proxy/0.log" Jul 03 19:35:55.770476 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:55.770446 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dmpcv_b11c9607-14c8-4605-b083-2c4aaf8e2bf6/istio-proxy/0.log" Jul 03 19:35:55.804082 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:55.804048 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dmpcv_b11c9607-14c8-4605-b083-2c4aaf8e2bf6/istio-proxy/1.log" Jul 03 19:35:55.827123 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:55.827072 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-59h6g_78603a7e-d538-477d-8179-c8121425c885/payload-pre-processing/0.log" Jul 03 19:35:55.872290 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:55.872227 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qvr8m_7bd85cf4-10bf-4159-b4cd-1e35de3fe692/payload-processing/0.log" Jul 03 19:35:57.198519 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:57.198489 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-k6z8q_456b8ec8-eaf3-44ed-9cc6-5af3740ac744/discovery/0.log" Jul 03 19:35:57.214798 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:57.214360 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-994f4989b-9hntc_9a829d83-4443-450c-87cc-f7f1ce2d6771/kube-auth-proxy/0.log" Jul 03 19:35:57.252156 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:57.252129 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dmpcv_b11c9607-14c8-4605-b083-2c4aaf8e2bf6/istio-proxy/0.log" Jul 03 19:35:57.282557 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:57.282516 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-dmpcv_b11c9607-14c8-4605-b083-2c4aaf8e2bf6/istio-proxy/1.log" Jul 03 19:35:57.303798 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:57.303744 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-59h6g_78603a7e-d538-477d-8179-c8121425c885/payload-pre-processing/0.log" Jul 03 19:35:57.344034 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:57.343997 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qvr8m_7bd85cf4-10bf-4159-b4cd-1e35de3fe692/payload-processing/0.log" Jul 03 19:35:59.776923 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:59.776892 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-85l4s_3adc0527-678e-4d7e-9f59-01913ab54679/kube-storage-version-migrator-operator/1.log" Jul 03 19:35:59.778699 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:35:59.778677 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-85l4s_3adc0527-678e-4d7e-9f59-01913ab54679/kube-storage-version-migrator-operator/0.log" Jul 03 19:36:00.817696 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:00.817663 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mxvx_57a524e0-ad2c-406e-a6bf-1e2284235fc5/kube-multus-additional-cni-plugins/0.log" Jul 03 19:36:00.839049 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:00.839015 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mxvx_57a524e0-ad2c-406e-a6bf-1e2284235fc5/egress-router-binary-copy/0.log" Jul 03 19:36:00.860187 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:00.860156 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mxvx_57a524e0-ad2c-406e-a6bf-1e2284235fc5/cni-plugins/0.log" Jul 03 19:36:00.882283 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:00.882257 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mxvx_57a524e0-ad2c-406e-a6bf-1e2284235fc5/bond-cni-plugin/0.log" Jul 03 19:36:00.902437 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:00.902411 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mxvx_57a524e0-ad2c-406e-a6bf-1e2284235fc5/routeoverride-cni/0.log" Jul 03 19:36:00.919841 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:00.919812 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mxvx_57a524e0-ad2c-406e-a6bf-1e2284235fc5/whereabouts-cni-bincopy/0.log" Jul 03 19:36:00.938139 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:00.938106 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9mxvx_57a524e0-ad2c-406e-a6bf-1e2284235fc5/whereabouts-cni/0.log" Jul 03 19:36:01.275733 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:01.275658 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lv8dm_934e4c19-32e3-4339-a015-0cb04970cd53/kube-multus/0.log" Jul 03 19:36:01.321820 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:01.321768 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dnsmw_003930ac-166e-4958-b6e8-30444b6e6fec/network-metrics-daemon/0.log" Jul 03 19:36:01.337212 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:01.337183 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dnsmw_003930ac-166e-4958-b6e8-30444b6e6fec/kube-rbac-proxy/0.log" Jul 03 19:36:02.389072 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:02.389035 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvdx5_ecc3701f-7faf-4848-bb1f-09ff724650d0/ovn-controller/0.log" Jul 03 19:36:02.409313 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:02.409275 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvdx5_ecc3701f-7faf-4848-bb1f-09ff724650d0/ovn-acl-logging/0.log" Jul 03 19:36:02.434642 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:02.434616 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvdx5_ecc3701f-7faf-4848-bb1f-09ff724650d0/kube-rbac-proxy-node/0.log" Jul 03 19:36:02.455794 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:02.455720 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvdx5_ecc3701f-7faf-4848-bb1f-09ff724650d0/kube-rbac-proxy-ovn-metrics/0.log" Jul 03 19:36:02.474584 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:02.474553 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvdx5_ecc3701f-7faf-4848-bb1f-09ff724650d0/northd/0.log" Jul 03 19:36:02.493091 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:02.493027 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvdx5_ecc3701f-7faf-4848-bb1f-09ff724650d0/nbdb/0.log" Jul 03 19:36:02.512448 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:02.512417 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvdx5_ecc3701f-7faf-4848-bb1f-09ff724650d0/sbdb/0.log" Jul 03 19:36:02.576408 ip-10-0-130-57 kubenswrapper[2587]: I0703 19:36:02.576375 2587 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvdx5_ecc3701f-7faf-4848-bb1f-09ff724650d0/ovnkube-controller/0.log"